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(57) Abstract 

A video composition appar- 
atus and method select segments 
from image source material stored 
on at least one storage media (15) 
and denote serially connected se- 
quences of the segments to thereby 
form a program sequence. The ap- 
paratus and method employ picto- 
rial labels associated with each seg- 
ment for ease of manipulating the 
segments to form the program se- 
quence. The labels displayed on an 
ordered spatial array of display 
monitors (32-68) to simulate the 
temporal relationship between be- 
tween the segments in what is typi- 
cally a nontemporal display. The 
composition control function is 
highly user interactive and re- 
sponds to user commands for se- 
lectively displaying segments from 
the source material on a pictorial f f _,, 1 _ all - tv n fc e i ec ted segments to form de- 

display. The control function allows the user to denote a start and end of e *f above, 
fined segments, identify each selected segment by a pictona image W^^jJJ ^^^^^^oX se- 

media. 
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Background of the Invention 

This invention relates generally to an 
apparatus and method for composing visual source 
5 material. In particular, the invention provides an 
apparatus and method for dynamically composing stored 
source material for producing a composition sequence, 
the electronic data necessary to form the composition 
sequence, or edited output. 

10 over the past two decades, video tape has 

substantially replaced the traditional photographic, _ 
e.g. silver halide, and other "non-electronic" film as 
the preferred media on which to film or compose a 
movie, news, or other program material. The increasing 
15 use of video tape has occurred despite certain inherent 
limitations associated with video tape in comparison • 
with traditional film. Video tape, like a developed 
photographic film, is inherently a "serial access- 
medium; however an editor is unable to "see" the images 
20 on the video tape medium. The video editor must 

instead rely upon electronic apparatus to read and view 
the images and to compose them to produce an edited 
product. To. the contrary, the film editor is able to 
have "hands-on" access to the film and can directly 
25 view the visual scenes thereon. The film editor can 
cut and splice the film in the editing room. 

The departure from film to video tape has 
dampened creative talents in some respects, in that the 
director is no longer able to apply subjective talents 



OMPI 

•A, ~ wipo 



WO84/02606 PCT/US83/01955 



-2- 

directly to the program medium. Instead/ intermediate 
technically-skilled operating personnel are employed to 
control- the electronic composing process, taking orders 
from the director- The orders are in terms of data, 
5 e.g., alphanumeric addresses of different taped 
sequences, rather than in terms of visual images. 

The intermediate personnel thus perform the 
real time hands-on manipulation of the video tape in an 
abstract environment of alphanumeric information and 
10 work with bays of switches on a complex control panel. 
The director* s feel for the composition process is 
diminished, and the composing process is , as a con- 
sequence, slow and tedious, with lessened subjective 
interaction. 

15 it is also known that one advantage to com- 

posing film media is the ability to react to the tem- 
poral nature of the media. Edited film can be browsed 
back and forth, picked up and viewed, like a book, and 
physically spliced. These advantages do not yet exist 

20 in present. day video composing equipment. 

Therefore, primary objects of the invention 
are increasing the throughput in the composing of video 
source material, lessening or even removing the need 
for intermediate personnel so that the director is 

25 closer an& more involved in the composing process, and 
solving the time-space problem inherent in video tape 
composition. Other objects of the invention are a 
flexible composition apparatus and method, and a 
reliable and user-friendly apparatus and method that 

30 can be employed directly, or indirectly, to create 

automatically a final edited master. Other objects of 
the invention will in part be obvious and will in part 
appear hereinafter. 
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Overview of the Invention 

Stated broadly, the invention provides equip- 
ment and methods for processing image information with 
improved human interaction. In a preferred practice 
5 the invention, the image information is video images, 
as conventionally recorded and stored with electronic 
signals. The equipment and method have many applica- 
tions . 

a 

In one aspect, the video processing equipment 
10 according to the invention makes it possible for an 
operator to scan visually through a vast library of 
stored video images with greater speed and control than 
previously possible. This new search capability which 
the invention provides has many uses. An illustrative 
15 one is for a news service to search a video data base 
for film clips of a subject that has suddenly become 
newsworthy. 

Another aspect of video processing equipment 
according to the invention makes it possible for an 
operator to assemble a collection of video images into 
a program sequence, with a new degree of speed, faci- 
lity and ease. An example of this use of the invention 
is to compose a television program from a collection of 
shots recorded at different times and/or from different 
25 sources. 

In each application of the invention, the 
video source material is in the form of groups of 
frames, typically sequential, as results from filming a 
scene with a video camera. The groups of frames, 
30 referred to herein as segments, can be stored, when 
received by the equipment, in an unknown or an unde- 
sired order. The composition equipment enables an 
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operator to search the sequences of video segments/ 

examine them as desired, and to select portions of any 

secjuences for sorting or reordering, for trimming, and 

for introducing different transitions from one segment 

to another — all with human ease, responsiveness, and » 

subjective interaction akin to that of a skilled driver ^ 

of a performance automobile. * 



Equipment according to the invention 
10 generally employs a bank of independently operable 

video tape recorders for storing two or more duplicate 
counterparts of the video source material. The equip- 
ment also has several monitors on which the video 
source material and video labels can be displayed for 
15 " operator viewing. A video label is, in the context of ; ■ 
this invention, a representation derived from a frame 
of source material. A typical label is a low resolu- 
tion digital representation of a high resolution source 
image. Such a label can be electronically stored and 
20 accessed at high speeds, yet when viewed by an opera- 
tor, the label provides nearly the same information as 
the corresponding high resolution source material. 

In one illustrative embodiment of this equip- 
ment,: there is a first, main monitor on which a 

25 selected sequence or other video segment can be 

repeatedly displayed, as if recorded on an endless 
loop. A set of secondary monitors can display selected 
scenes of a video sequence, typically of the sequence 
being displayed on the main monitor. In addition, 

30 there preferably are two linear arrays of passive 

display monitors. One array is positioned above the 
.other so that each monitor of the upper array is paired 
with, and aligned above, a monitor of the lower array. 

An operator standing or sitting before this 
3 5 video display system controls it with two sets of 



OMPI 



kBNSDOCID: <WO 840260SA1 



WO84/02606 



PCT7US83/01955 



10 



15 



20 



controls, one for each hand. Each control set has a 
cluster of finger switches, e.g., push-buttons, 
arranged with a large wheel for tactile operatxon with 
minimal hand movement. 

in general operation, the illustrated embodi- 
ment of this equipment can include operating modes 
termed "output", "sort", "trim" and "splice". An 
operator enters video source material into the equip- 
ment, i.e. stores it on the video recorders, with the 
input mode. The operator can view the video images, 
typically on the main monitor, as they are being 
entered. The operator generally controls the equipment 
to prepare and store label pairs of the source material 
as it is being entered. The label pairs can be opera- 
tor selected incoming video frames, or can be automati- 
cally selected by the equipment on a repeating basis, 
e g., every thirtieth input frame. Each label includes 
information identifying the corresponding segment of 
source material, preferably identifying an address 

ie cfnrpd on the video tape recbr- 
where that segment is stored on tne 

ders. 



in the illustrated sort mode of operation, an 
operator assembles selected label pairs, representing 
st'ored video source material, in a desired program 
25 sequence. The sequence of the label pairs is indepen- 
dent of the sequence according to which the source 
material is stored in the equipment. 

More particularly, in this sort mode, an 
operator can select one or more labels representing any 
30 stored video segment and place it in selected sequence 
with one or more labels representing another video 
segment. Further, the operator can rearrange the 
sequence of the selected labels. In one use of .the 
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equipment, the operator selects a label pair and the 
video segment Which it represents is then displayed 
with continuous repetition on the main monitor screen 
while the labels for that segment are displayed on the 
secondary monitors. 

In the trim mode, the operator can shorten or 
lengthen any selected segment as it is being" repeatedly 
displayed on the main monitor. The secondary monitors 
in this mode of operation display labels representing 
the first and last frames of the "trimmed" segment. 



When the operator has assembled two or more 
selected and sequentially ordered and trimmed segments 
in this manner, the beginning and ending labels of each 
trimmed segment can be displayed on one set of the 
15 passive monitors, in the selected sequence. Further, \ 
the operator can collapse two or more of such sorted 
segments if they are contiguous and represent, as a 
single label pair displayed on the passive monitors, 
the plural segments forming the collapsed group. 

2o An operator uses the splice mode of operation 

to edit the transition between sorted video segments. 
The equipment in one embodiment of the invention 
enables the operator to control the length of a tran- 
sition, the type of transition, the starting and 

25 stopping points of the transition, and the number of 
frames over which the transition occurs. 

Several particular features of the invention 
further increase the effectiveness of this equipment 
and method. For example, the illustrative equipment, 
30 according to the invention, provides the operator, in 
the sort mode, with the capability of smoothly 
scrolling label images across the array of passive 
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monitors. The display in essence slides the label 
images across the displays, in line with preceding and 
subsequent labels. 

Another form of display which the invention 
5 features, termed "action scrolling", allows the opera- 
tor repeatedly to view any region of a segment, typi- 
cally the beginning and end of the segment. This is 
useful, for example, in trimming or splicing a video 
segment. Thus, the equipment, according to one embodi- 
10 ment, allows an operator to rotate one control wheel 

back and forth to roll the visual presentation back and 
forth over a number of frames. The equipment can 
respond to the amount of wheel rotation by displacing : a 
corresponding number of frames, and can respond to che 
15 speed of rotation by. rolling from frame to frame at a 
corresponding frame rate, at least up to a maximum 
speed. 

Equipment according to the invention further 
features both a . "video-style" and a "film style" 
20 display. The operator can switch back and forth be- 
tween the two presentation formats in accordance with 
the editing functions being undertaken. 

Throughout all these operations, the operator 
typically continually views "only the television raoni- 
25 tors, and is free to focus attention exclusively on the 
displayed visual images of labels and source material. 
The equipment, and the methods it implements, enable 
the operator to steer, shift and otherwise control the 
visual material with only a turn of the knob and a 
30 change of the switches at either hand — entirely on an 
intuitive, tactile basis without any need to view the 
controls or move a hand from continuous engagement with 
either set of controls. The operator thus enjoys s ^^%ZA5T 
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jective interaction with the material being displayed 
and- composed with high levels of both visual and tac 
tile feedback. 
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fiummar y of the Invention 

The invention, as previously noted, relates 
to a video composition apparatus and method for dynami- 
cally selecting segments from image source material and 
denoting serially connected sequences of segments which 
will make up the composed production material. The 
source material is stored in at least one storage 
medium, in the illustrated embodiment, one or more 
video tape recorders. 

The apparatus of the invention features a 
pictorial display system, an operator responsive 
control system, and a composing control system respon- 
sive to the operator control system for controlling the 
storage media and the pictorial display system. The 
15 composing control system is typically a microprocessor 
or computer based system which features hardware and/or 
software (a) for selectively displaying segments of the 
image source material on the pictorial display system; 
(b) for denoting a start and an end of each of a plura- 
20 lity of selected segments of the source material; (c) . 
for identifying each selected segment by a pictorial 
image segment label; (d) for assembling at least a 
plurality of the labels into a serially connected label 
sequence; (e) for locating, in response to the operator 
25 control system, any selected segment by displaying the 
pictorial labels in a label sequence; and (f) for 
displaying the segment identified by a selected label. 

The invention, in a particular embodiment, 
further features a composing control system which is 
3 0 able to selectively operate upon the segments at at 
least two different levels of composition. The com- 
posing control system thereby features elements for 
grouping serially connected on«s of the connected 




WO84/02606 



-10- 



segments into segment groups, the segments xn related 
segment groups having the same connected serxal rela 
tionship as the segments in the connected xmage _ 
sequence, and the composing system being responsxve for 
5 identifying each segment group by a pictorial group 

label. The composing control system thereby xs selec- 
tively operable for locating any segment group by 
displaying the pictorial group labels in a group label 
sequence which corresponds to the segment group 
10 sequence. 

in order to provide the temporal relationship 
of the segments in what is inherently a non-temporal 
spatial representation of image label information, 
there is further featured in the pictorial display 
15 system, a plurality of pictorial display moni Ltors or 

screens which are arranged in an ordered spatxal array. 
The screens are provided with electrical signals pxc- 
torially representing a selected limited number of the 
sequence of labels and an operator responsive element 
for changing the displayed labels. Preferably, the 



20 



25 



display screens have associated therewith a dxsplay 
processor which is responsive to the composing control 
system for receiving electrical signals representing an 
image to be displayed and for providing that recexved 
image for display on the associated pictorial dxsplay 



screens . 



30 



While the labels themselves can be any 
desired available pictorial image, in the illustrated 
embodiment, the labels representing a segment are cho- 
sen from the segment frames and the label is composed 
of two pictorial frames. The composing apparatus 
thereby further provides elements for selecting the two 
pictorial frames, for example, a first label image 
corresponding to a frame near the beginning of the 
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segment and a second label image corresponding to a 
frame near the end of the segment. 

As noted above, video images can be stored in 
a serial storage media. Thereby, the apparatus 

5 features at least a first and a second serial storage 

medium, each storing a- representation of the segment to 
be displayed. The apparatus further features elements 
for selectively controlling image information retrieval 
from the two storage media for repetitively cycling the 

10 first and second storage media for alternate image 

information retrieval whereby a continuous loop presen- 
tation of the segment can be displayed. If desired, 
and preferably according to the preferred embodiment of 
the invention, circuitry is provided for inserting an' 

15 interruption display image between cycles or repeti- 
tions of the repeating segment thereby to provide a 
psychological break for the operator/editor. 
Alternately a single storage medium can be employed, 
provided that the time duration required for restarting 

20 a display is not excessive. 

The composing apparatus according to another 
aspect of the invention provides a first segment in a 
first serial storage memory and a second segment in a 
second serial storage memory. The composing control 

25 system further includes elements for selectively 

controlling the image information retrieval from the 
first and second serial memories for repetitively and 
alternately displaying the first and second segments 
whereby a continuous loop alternating presentation of 

30 the first and second segments is generated. This 

enables the transition from the first to the second 
segment to be displayed. The invention can further 
feature means for dynamically varying the transition 
between the first and second segments or for providing 
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a different transition display between the first and 
second segments. It is possible to dynamically change 
the^ start and the end of each of the first and second 
segments during operation of the apparatus. 

According to the invention, a plurality, for 
example up to twenty- two or more, video tape recorders 
can be employed for serial storage. Associated with-, 
each video tape recorder is a video tape recorder 
interface, each interface being connected to the com- 
posing control system. Thereby, the composing control 
system operates and controls each of the video tape 
recorders through its associated interface. 

In another aspect of the invention, passive 
display screens are each adapted to receive, after pro- 
cessing by a video digitizing circuit having an analog- 
15 to-digital converter and a read/write digital storage 
memory, video which is to be displayed on the passive 
display screens. Preferably, the video screen display 
is at a much lower resolution than that at which the 
image is recorded on video tape. A picture display 
20 processor is responsive to the composing control 

system for receiving electrical signals representing 
the image to be displayed and for repeatedly providing 
the received image on associated pictorial display 
screens, and the processor can receive as its input, 
25 the output from the video digitizing system. The video 
digitizing system has elements responsive to the com- 
posing control system for converting a video input from 
a switching system to digital data and for storing that 
digital data in memory. 



30 



The composing apparatus of the invention 
further has elements for receiving a plurality of video 
input lines and for directing each of the lines to 
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selected ones of the video tape recorders. In this 
connection, the apparatus also features a video clock 
generation circuitry for generating clock signals which 
can include SMPTE time code location signals. The com- 
5 posing control system then includes elements for selec- 
tively adding the location signals to the incoming 
video image data for storage on the video tape recor- 
ders. 

Importantly, during the operation of the 
10 apparatus, there is maintained a record of the sequen- 
ces of defined segments in accordance with the label 
selecting and defined elements. 

When new incoming video material is available 
for composing, it may be desirable to automatically 
15 divide that material into segments prior to actual com- 
posing in order to provide initial labeling identifi- 
cation which will facilitate later composing. The 
composing control system is therefore further provided 
with elements for automatically dividing the input 
source material into segments according to a predeter- 
mined selection method. Thereafter, of course, the 
operator control system can be employed for changing 
the beginning and ending frames of the segments. The 
segment presentation displayed on an active display is 
25 dynamically updated to visually display the segment 
with the new beginning and ending locations. 

The apparatus further features a printer con- 
nected to the composing control system, an alphanumeric 
input keyboard for inputting,- to the composing control 
30 system, text material associated with a labeled scene, 
and wherein the composing control system provides ele- 
ments for printing a storyboard. The storyboard repre- 
sents thereon a series of scenes, each scene 
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represented by at least one pictorial label and pre- 
viously input text material, if any, associated 
therewith. 

The method of the invention features the 
5 steps of (a) selectively displaying segments of the 
image source material on a pictorial display system; 
(b) denoting a start and an end of each of a pluralxty 
of selected segments of the source material; (O iden- 
tifying each selected segment by a pictorial image 
10 segment label; (d) assembling at least a portion of the 
selected labels into a serially connected label 
sequencer (e) locating, in response to an operator 
control command, any selected label by displaying the 
pictorial labels in a label sequence; and (f ) 
15 displaying the segment identified by a selected label. 

The invention, in a particular embodiment, 
further features the step of selectively operating upon 
said segments at at least two different levels. The 
method thereby features grouping serially connected 
20 ones of the connected segments into segment groups, the 
segments in related segment groups having the same con- 
nected serial relationship as the segments in the con 
nected image sequence, identifying each segment group 
by a pictorial group label, and locating any of the 
25 segment groups by displaying the pictorial group labels 
in a group label sequence which corresponds to the 
segment group sequence. 

In order to provide the temporal relationship 
of the segments in what is inherently a non-temporal 
30 representation of image label information, the method 
further features providing a plurality of pictorial 
display screens arranged in an ordered spatial array to 
simulate the temporal order of the segments, providing 
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the screens with electrical signals pictorially repre- 
senting a selected limited number of the sequence of 
labels, and changing the displayed labels. The method 
also features receiving electrical signals representing 
5 an image to be displayed and repeatedly displaying that 
received image on an associated pictorial display 
screens. 

As noted above, video images can be stored in 
serial storage media. Thereby, the method features 
10 storing a representation of a segment to be displayed 
in a first and a second serial storage media. The 
method further features selectively controlling image 
information retrieval from the two storage media and 
repetitively cycling the first and second storage media 
15 for alternate image information retrieval, whereby a 
continuous loop presentation of the segment can be 

• displayed. If desired, and preferably according to the 
preferred embodiment of the invention, the method pro- 
vides for inserting an interruption display image bet- 

20 ween cycles or repetitions of the repeating segment 
thereby to provide a psychological "break" for the 
operator. 

The composing method, according to another 
aspect of the invention, features the steps of storing 

25 a first segment in a firsf serial storage memory and a 
second segment in a second serial storage memory, 
selectively controlling the image information retrieval 
from the first and second serial memories, and repeti- 
tively and alternately displaying the first and second 

30 segments whereby a continuous loop alternating presen- 
tation of the first and second segments is generated. 
This enables the transition from the first to the 
second segment to be displayed. The invention can 
further feature varying the transition between the 
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first and second segments or providing a different 
transition display between the first and second 
segments. It is possible to dynamically change the 
start and the end of each of the first and second 
5 segments during operation of the apparatus. 

The composing method of the invention further 
features, in another aspect, the steps of receiving a 
plurality of video input lines and directing each of 
the lines to selected ones of the video tape recorders. 
10 in this connection, the method also features generating 
clock signals which include SMPTE time code location 
signals, and selectively adding the location signals to 
incoming video image data for storage on a video tape ^ 
recorder. 

15 when new incoming information is available 

for composing, it may be desirable to automatically 
divide that material into segments prior to actual com 
posing in order to provide initial labeling iden- 
tification for ease of composing. The method therefore 
20 further features automatically dividing the input 

source material into segments according to a predeter- 
mined selection method. Thereafter of course the 
operator can change the beginning and ending frames of 
the segments whereby the segment presentation displayed 
25 on an active display is thereby dynamically updated to 
visually represent the new beginning and ending loca- 
tions. 

The composing control circuitry further 
features elements for selectively supplying each pic- 
30 torial display device with electrical data signals 

representing a selected one of the sequence of labels. 
Elements of the control circuitry are responsive to the 
operator control device for changing the labels 
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displayed by the plural pictoral display elements. The 
supply elements further have circuitry responsive to 
the* changing element for smoothly scrolling the labels 
across the ordered array of display elements. 

In a particular embodiment, the smoothly 
scrolling system has a display processing control cir- 
cuit and a display processing unit having at least one 
row processor. Each row processor features a plurality 
of digitized picture generators for receiving digitized 
10 picture data representing a picture to be displayed and 
for generating an analog picture output representing 
the digitized picture data. Each row processor further 
features a plurality of analog routing elements, each 
element having as its inputs, at least a plurality of 
the picture generator analog circuits outputs. Each 
routing element is then adapted to select its output 
from among the picture generator output signals in 
response to a controlling input signal. 

In another aspect of the invention, the com- 
posing apparatus operator input element features an 
operator controlled manually operable control panel. 
The control panel features a first rotary control 
wheel, a second rotary control wheel, a first plurality 
of control key elements adjacent the first control 
wheel, and a second plurality of control key elements 
adjacent the second control wheel. The first plurality 
of control elements and the first control wheel have a 
first spatial configuration for providing tactile stim- 
ulation feedback to an operator of the apparatus. 
Similarly, the second plurality of elements and second 
control wheel have a second spatial configuration also 
for providing tactile stimulation feedback to the 
apparatus operator. Thereby, the operator can visually 
concentrate on the display elements while operating the 
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manual control panel elements with high tactile feed- 
back and with minimal need for visual feedback. 

The particular spatial configuration of key 
elements according to one aspect of the invention has, 

5 for each wheel, a first plurality of the elements 

arranged in a spaced apart linear array juxtaposed to 
the first control wheel and a second plurality of key 
elements arranged in a second spaced apart linear array 
juxtaposed to the first linear array and along the side 

10 thereof spaced away from the control wheel. The key 
elements at each end of the first and second linear 
arrays define respectively an upper and lower tactile 
feedback region. A plurality of key elements at the 
interior of the first stimulation array define respec^- 

15 tively an upper and lower interior tactile stimulation 
region. 

Yet another aspect of the invention features 
a method for use in a composing apparatus for selecting 
segments from image source material stored on at least 

20 one storage medium and for denoting serially connected, 
sequences of the segments. The method comprises the 
steps of arranging a manually operated control panel 
for providing tactile stimulation feedback to an opera- 
tor of the composing apparatus and enabling the opera- 

25 tor to visually concentrate on a pictorial display 

while operating the control panel with minimal visual 
feedback from the key elements. 

Another aspect of the invention features a 
plurality of cursor indicating elements for use with a 
30 composing apparatus. Each element is associated with a 
passive display element, and a composing control cir- 
cuitry is adapted to operate with the storage medium 
and an operator control device. The composing device 
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circuitry features circuitry responsive to the operator 
control device for selecting among the label frames 
displayed on the passive displays for editing the 
source material. The selecting circuitry has a cursor 
5 control circuitry for selecting from among a plurality 
of cursor indicating elements. The selected indicating 
element thereby designates the selected label field. 

Another aspect of the invention features a 
method of editing segments from image source material 

10 stored in at least one storage medium and of denoting 
serially connected sequences of the segments. The 
method features the steps of selectively displaying 
segments of the image source material on a pictorial 
display. The method further features identifying each 

15 segment by a pictorial image segment label, assembling 
at least a plurality of labels into a label sequence, 
and combining or collapsing a sequentially related 
plurality of labels into a single label. The single 
label identifies a plurality of segments. In the pre- 

20 ferred embodiment, the segments are contiguous on the 
video tape. 

This method further features the steps of 
providing a plurality of pictorial display screens 
arranged in a first and a second spaced apart linear 

25 array and providing juxtaposed to each display screen a 
• cursor position indicating element. The method then 
features providing the display screens with electrical 
signals pictorally representing a selected sequence of 
label pairs, each label pair on a spatially related 

30 pair of the display screens, one screen displaying a 
beginning label and the other, related screen 
displaying an ending label of the pair. The method 
further features the steps of identifying, using a cur- 
sor indicating element, a beginning label of the single 
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label; identifying, using a cursor indicating element, 
a later occurring ending label of the single label, and 
collapsing the 'beginning label, the ending label, and 
all labels therebetween into the single label (in the 
> preferred embodiment, a single label pair) . 

In a particular embodiment of this method, 
the collapsing step features the steps of first fixing 
the cursor position at an indicating element associated 
with the beginning label of the first segment label 
L0 pair; moving or positioning the cursor associated ori- 
ginally with the ending label of the first label pair 
from a position juxtaposed to that first segment ending 
label to a position-indicating element juxtaposed to 

* * 

the ending label of the second segment label pair; and 
15 fixing the cursor in position at the indicating element 
associated with th ending label of the second segment 
label pair. 

In yet another aspect of the invention, the 
composing apparatus features an action scrolling 
20 apparatus having equipment responsive to an operator 
control device for selectively displaying successive 
frames of a segment on a pictorial display screen, the 
operator control device having an operator controlled 
manual rotation wheel for varying the segment frame 
25 displayed oh the display screen. The rotation wheel 

has a plurality of operating positions, each successive 
position corresponding to the display of a next suc- 
cessive frame oh the display screen, the direction of 
the next frame with respect to the present displayed 
30 frame corresponding to the direction of the rotation of 
the rotation wheel. Thereby, back and forth rocking 
rotational movement of the rotation wheel provides - for 
back and forth action scrolling of the segment frames 
on the display screen. 
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This last aspect of the invention features a 
method for action scrolling which features the steps of 
displaying segment frames on a pictorial display 
screen, varying the segment frames displayed on the 
5 display screen by using an operator controlled manual 
rotation element, and rotating the element back and 
forth for providing the back and forth action scrolling 
of the segment frames on the display screen. 

In a further aspect, according to a preferred 
10 embodiment of the invention, the composing apparatus 

has elements for temporally trimming the segments. The 
trimming elements feature circuitry for selectively 
displaying a segment to be trimmed on a pictorial 
display screen and circuitry for displaying a starting 

15 and an ending frame of the segment to be trimmed. An 
operator responsive circuit changes at least one of the 
beginning and end of the displayed segment in response 
to an operator control device. The operator control 
device has a beginning frame control wheel and an 

20 ending frame control wheel for changing, in combination 
with the operator responsive circuitry, the beginning . 
and end respectively of the displayed segment. 
Preferably, a first accept key and a second accept key 
indicate, when simultaneously activated, that a newly 

25 trimmed segment is to replace the segment originally 
displayed. 

In another aspect of the invention, a 
trimming method for use in the composing apparatus 
features the steps of selectively displaying a segment 
30 to be trimmed on a pictorial display screen and 

displaying a starting frame and an ending frame of the 
segment to be trimmed. The method further features the 
steps of changing at least one of the beginning and end 
of the displayed segment in response to operator 
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controls. The method can also feature providing a 
fail-safe system which requires simultaneous actuation 
of 'two spaced-apart elements for accepting a new, tem- 
porally changed, display segment. 

5 The composing control device further features 

elements for selectively supplying each pictorial 
display element, while the source material is being 
received and recorded, with electrical data signals 
representing a selected one. of the sequence of labels, 

10 and has elements responsive to the operator control 

device for sorting the label sequence displayed by the 
pictorial display elements. 

The composing method further features the 
steps of identifying each segment by a pictorial image 

15 segment label, displaying a transition from one segment 
to a next segment in a continuing loop display on a 
display screen, and displaying the end frame of the 
"from" segment and the beginning frame of the "to" 
segment on respective display screens. The method 

20 further features providing a selected one of a film- . 
style presentation and a video-style presentation of 
the end frame and the beginning frame and selectively 
switching, under operator control, between the film- 
style and video-style presentations. 



25 



30 



In a particular preferred aspect of the 
invention, the method further features the step of 
highlighting the frames of the segments in the film- 
style presentation for displaying the transition bet- 
ween segments. 

Another aspect of the apparatus features a 
flexible routing circuitry which employs a single bus 
having a plurality of transmission paths. Each source 
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of video data can connect to a separate transmission 
path so that all video data can be made available in 
the* system. Further, routing circuits connecting to 
each transmission path, under the control of a 

5 controlling circuit, can provide a selected video data 
signal to an associated receiving circuit. Thus, any 
receiving circuit can obtain video from any of the 
transmission paths. When video tape recorders are 
employed, there is provided an associated interface 

10 circuit for controlling the routing circuit while pro- 
viding the tape recorder with the video input signal 
required in accordance with the control processor 
instructions. 

The apparatus further, when directing source 
15 material to - each of a plurality of video recorders, 
records along with the time codes available from the 
source, an internal time code which is associated with 
each frame. The internal time code is synchronized 
from recorder to recorder so that the same internal 
time code is associated with a frame on all tape recor- 
ders. A system clock generator provides the necessary., 
clock and timing signals so that each interface cir- 
cuitry can provide the necessary time code information. 
Thereby, the time difference between two frames on the 
25 tape recorder is equal to the difference in time codes 
provided in accordance with this preferred embodiment 
of the invention. 

Another aspect of the invention features a 
method for displaying, in a continuous loop fashion, an 
30 arbitrary grouping of segments. The method provides 
for determining the sequence in which the video tape 
recorders shall be operated and, in accordance with the 
method, the time at which a video tape recorder is to 
operate, the position from which it is to operate, and 
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its duration of operation are provided to the VTR 
interface. Thereby, a continuous loop presentation of 
an 'arbitrary grouping of segments can be displayed for 



review. 



These and other features of the equipment and 
method of the invention described and illustrated 
herein provide significant improvements in the human 
processing of image information. 
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Brief Description of the Drawings 



" Other objects, features, and advantages of 

the invention will appear from the following descrip- 
tion of preferred embodiments, taken together with the 
5 drawings in which: 

Figure 1 is a perspective view of the com- 
posing apparatus according to the invention- 
Figure 2 is a detailed schematic block 
diagram of the electrical circuitry according to the 

10 invention; 

Figure 3 is a detailed plan view of a typical 
console according to the invention; 

Figure 4 is an electrical block diagram 
showing those elements used for the smooth scrolling 
15 display generation and control for the passive display 
screens; 

Figure 5 is a detailed electrical diagram 
showing the elements necessary for providing a smooth 
scroll of rhe video images across the passive display 

20 screens; 

-Figure 6 is a partial electrical schematic 
diagram corresponding to Fig. 2 and showing the ele- 
ments necessary for displaying and controlling video on 
the active display screens; 



25 



Figure 7 is a partial electrical schematic 
diagram corresponding to Fig. 2 and showing the por- 
tions of the system which input video to the apparatus; 
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Figure 8 is a detailed block diagram of the 
video tape recorder interface of Fig. 2; 

Figure 9 is an enlarged plan view of a manual 
control assembly for the apparatus; 

Figure 10 is a flow chart showing controller 
operation during the input mode of operation; 

Figure 11A-11F are flow charts showing 
controller operation during the sort mode of operation; 

Figure 12 is a flow chart showing controller 
10 operation during the trim mode of operation; 

Figure 13 is a flow chart showing controller 
operation during the splice mode of operation; 

Figure 14 is another embodiment illustrating 
an alternate routing circuitry to that of Fig- 2; 

Figure 15 is a detailed block diagram of a . 
15 video tape recorder interface as modified for the 
routing circuit of Fig. 14; 

Figure 16 is a more detailed electrical block 
diagram of the routing circuit of Fig. 14; and 



Figure 17 is a detailed electrical diagram of 
the cross-point array circuitry of Fig. 16. 
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n^i-i ption of Preferred E mbodiments 
Rpneral Desc ri ption of the Apparatus 

The illustrated embodiment of the invention 
is directed to composing image source material stored 

5 in a memory medium, for example , video tape used with a 
video tape recorder, to produce a sequential grouping 
of segments making up a program or story. In some 
applications, composition can, but need not, further 
include the editing function of creating a final edited 

10 master. Typically, the image source material either is 
derived from already existing, production quality video 
tape(s) or is provided, in real time, from one or more 
video cameras for recording on video tape. 

In its standard format, the video signal has 
a plurality of frames, each frame having two fields. 
The video is displayed for normal viewing at a rate of 
thirty frames per second. When the video tape is pre- 
pared, the recording device associates with each field 
a specific address or identification tag. The address 
is typically written in accordance with the SMPTE time, 
code, a standard used throughout the television 
industry. Thus, irrespective of the source of the 
video material, there is associated with each field or 
the recorded signal, a unique address or location which 
is read when the field is read or otherwise retrieved. 



15 
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Referring to. Figure 1, a video composition 
system 10 has a control console 12 from which an 
operator/editor controls the operation of the entire 
system and provides the composing instructions which 
enable the system to prepare a listing of video 
segments to be serially connected to form a finished 
composition sequence. As used herein segment refers to 
a sequence of frames. The frame sequence may form a 
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shot, a scene (a sequence of shots), a picture sector 
(a sequence of scenes), a program or story (a sequence 
of "picture sectors), or any other desired grouping of 
frames. 

According to the illustrated embodiment of 
the invention, the system employs a plurality of serial . 
storage media 13. The storage media need not be 
limited to serial storage; however, present technology 
has not provided a random access storage medium of suf- 
10 f icient capacity and reasonable cost to replace the 

serial storage medium. In the illustrated embodiment, 
the serial storage media are video tape recorders 
(VTR's) such as those commercially sold and manufac- 
tared by Sony Corporation under model No. 2500. Th,s ■ 
1S VTR operates according to a Beta II or Beta III rape 
format, has multiple heads for both simultaneous 
recording and retrieval, provides a times-two and a 
times-ten or times-fifteen speed control, a frame 
freeze for both forward and reverse modes, and allows 
20 significant remote control capability. Referring also 
to Figure 2, the illustrated VTR' s , labeled 14, 16, 18,; 
and 20, interface with a computer/controller 22 through 

respective recorder interfaces 24, 26, 28, and 30. 
While only four VTR's are shown in the figures, it is 

-. i. jx 4-v, = t- svstem 10 will include up to 

25 contemplated that tne system j-u 

twenty-two or more VTR's to accomplish the many func- 
tions and provide the many features to be described 
hereinafter. For purposes of simplicity in the 
drawing, more VTR's have not been shown but have been 
30 indicated by the plurality of dots between the various 
recorders 14, 16; and 16, 18; and 18, 20. 

The control of the entire system depends upon 
the man-machine interaction available from the control 
console 12. Referring to Figures 1 and 3, the 
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illustrated control console has a large main display 
screen 32 flanked by a plurality of smaller display 
screens 34, 36, 38, and 40. There are further provided 
a plurality of yet smaller label display screens 42, 
44, 46,..., 68, arranged in a two row ordered array. 
Below the label display screens is a manual control 
panel 70 which includes a right hand control wheel 74 
and a left hand control wheel 76. Adjacent the control 
wheels are a number of control keys 78, 79, 80,..., 99, 
and levers 100, 101, 102, 103 whose functions are 
described in greater. detail below. 



The apparatus 10 also has a keyboard unit 10 4 
having a simplified typewriter keyboard for entering 
alphanumeric information into the computer/controller" 
15 22 and for responding to requests for information or 
instructions which appear on a display screen monitor 
105. In the illustrated embodiment of the invention, 
the typewriter keyboard and monitor are housed apart 
from console 12, although the monitor and keyboard 

20 could also be integrated with the console 12 as. 

described in copending U.S. application, serial number 
452,287. The preferred and described layout of the 
control console 12 can be changed in accordance the 
needs of the particular application. Thus, other 

25 applications can -require a different arrangement of the 
components and/or different numbers of display screens 
'or other controls. 

The apparatus is heavily user interactive. 
From the control panel 70 the operator/editor can 
30 effect substantially any operating mode which is 

required for composing a video program from one or more 
available source video tapes. As noted above, the sce- 
nes recorded on video tape are made up of a sequence of 
frames, each frame being composed of two interlaced 
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or 



television fields. The composition apparatus 10, in 
the illustrated embodiment, is capable of operating 
upon the frames forming the source video at any of a 
number of operating levels. According to the preferred 
5 embodiment of the invention, each operating level can 
be viewed as a "bin". Each bin contains a plurality of 
segments displayed as groups of label pairs, and each 
class of bins has a separate and distinct purpose, 
example, at the lowest or most elementary level, there 
10 is a "source bin". The source bin represents the 

operating level at which source material is read by and 
stored in the apparatus. At another operating level, 
there exists a "discard bin." The discard bin, as its 
name implies, contains those segments which, while once 
15 belonging in the source bin, have been "discarded" and 
removed, for example from the source bin. The 
"discarded" segments can be later retrieved as 
described in more detail below. 



20 



Another operating level, the so-called 
"select bin", acts like a temporary scratch pad memory, 
in which the apparatus stores segments on a last in, 
first out (LIFO) basis. The select bin operating level 
is useful for moving segments from for example the 
source bin to for example a higher level bin. The 
.25 higher level bins, of which there are four according to 
the illustrated embodiment, are "program bins". It is 
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at-., the program bin operating level that program 
material is sorted, trimmed, and spliced. 

(In an alternate embodiment of the invention, 
by way of further example, the operating levels can be 

5 designed according to a completely different philo- 
sophy. According to one alternate operating method, at 
the lowest or most elementary level (the zero level), 
the apparatus can operate upon one frame at a time. At 
a higher level, the apparatus can operate upon prede- 

10 termined segments of m n frames where n, an integer, 

represents the operational level (level "1", level "2", 
etc.) and m is an arbitrary integer greater than 1. : - 
For example, if m equals seven, level one operates upon 
segments of seven frames, level two upon segments of 

15 forty-nine frames, etc. 

A predetermined segment, however, will not 
generally correspond to a shot, a scene, etc. 
Therefore, the apparatus has the further capability, in 
this alternate operating level embodiment, of allowing 

20 the operator to designate segments of connected frames. 
At the operator designated levels of operation, the 
frames, when sequentially connected together, in the 
most elementary sense form "shots" (analogous to film 
clips). A plurality of shots (or clips) can be spliced 

25 together to form a scene and a plurality of scenes can 
be spliced together for forming a video sector. 
Correspondingly, a plurality of video sectors together 
forms an entire program or story. In this alternate 

30 embodiments the invention, the apparatus operates at 
any of the levels of shot, scene, or sector as well as 




WO84/02606 



PCT/US83/01955 



-32- 

n 



10 



at predetermined levels "0", "1% "2", and "3 
described above. Thus depending upon the level of 
operation selected, in the alternate embodiment, the 
apparatus can operate upon either individual frames 
(level 0), a predetermined group of frames (levels 1, 
2, and 3), or at the shot level (level 4), the scene 
level (level 5), or the sector level (level 6).) 

Referring again to the preferred and 
illustrated embodiment of the invention, source 
material read into the source bin, can have segments 
(or clips) marked off (but not physically divided) in a. 
number of ways. The segments can be designated by, for 
example, regular sampling, wherein a segment is marked 
with labels extracted at a repeating predetermined time 
duration such as one second. Another method employed, 
according to the invention, for- marking off source - 
video into segments, relies upon an operator actuated 
control panel key which enables the operator to mark 
off the incoming source material into segments by 
) making preliminary decisions on-the-fly. 

In either instance, the composition apparatus 
10 uses pictorial labels to designate each segment (or 
a sequence of frames) of the video material being com- 
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posed. Thus, instead of forcing the user to manually 
identify and record a video segment by either the SMPTS 
time codes or another artificial determination, one or 
more fields or frames of the segment (preferably digi- 

5 tized frames together with their machine retrievable 
SMPTE address codes), are employed to pictorially 
"label" the segment. The labels can be, as described 
below, the frames at the beginning and the end of the 
segment. In other circumstances, the labels can be 

10 near the beginning and the end of the segment, or 
elsewhere. 

Furthermore, more than one label can be used, 
for a segment. In the illustrated embodiment of the 
invention, two labels are used, one pictorial label 

15 corresponding to the frame at the beginning of the 
. segment and a second pictorial label corresponding to 
the frame at the end of the segment. (Alternately, one 
label can be employed during an initial "rough cut" and 
two labels can be used for the later composition work.) 

20 As the segments are assembled, in a desired order as 
described hereinafter, the labels corresponding to the 
segments are similarly ordered. 
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In the illustrated embodiment of the inven- 
tion the display screens 42, 44, 46 68 are 

designated "passive displays" and are generally _ 
employed for presenting a spatial display of the label 
5 pairs associated with a sequence of segments, one ver- 
tical pair of display screens showing the beginning 
label (top display) and the ending label (bottom 

The video segment associated 
display) of a segment. The viaeo y 

«-p *-h<* label pairs, designated by a 
with a selected one of the laoej. pai»' 

*Hn tv-Dicallv be displayed on the mam 
10 control cursor, will typicaiiy ^ c 

screen or "active display" 32. The beginning and 
ending labels of the segment being displayed on the 
active display 32 will typically be displayed on 
various of screens 34, 36, 38, 40 depending upon the 
15 mode of -operation as described below. 

in the illustrated embodiment, if the control 
cursor, the location of which is indicated by illumina- 
tion elements 324 and controlled by lever 100, (Figure 
3), were set to the center screen pair of the passive 

• -, . hat i= to displays 54, 56, the segment 

20 displays, that is, ro ai^y-a* . 

- - „ _ rii-olavs 54, 56 will generally be 
corresponding to displays 

m= i„ «, ree n 32. Further, the appara- 
displayed on the mam screen . j*. ^ ^ 

tus displays pictorial label pairs corresponding to the 
just preceding three earlier segments on the three pre- 
25 ceding vertical display screen pairs , i. e ., displ-y 

pairs 42, 44; 46, 48; and 50, 52. Similarly, the pic- 
torial label pairs corresponding to the next succeeding 
three occurring segments are presented on passive 
display screens 58, 60; 62, 64; and 66, 68. Thereby, 
30 the control console provides a spatial display corres- 
ponding to the temporal image presentation. This 
snapshot-type multiple label display enables the user 
to maintain in temporal perspective, where the pre 
sently displayed segment on screen 32 "fits" m the 
35 segment sequence. 
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Ref erring now to Figure 2, the communications 
and data management center of the apparatus is the com- 
posing computer/controller 22. The computer/controller 
has a central processing unit which can be for example 
5 an Omnibyte OB68K1A, manufactured" by Omnibyte of West 
Chicago, Illinois. Associated with the controller 22 
is a printer 106, for example a dot matrix printer such 
as the Versatec V80 manufactured by the Versatec 
Division of Xerox Corp. The controller 22 further has 
10 a digital data bus 107 for transmitting digital data 
between the computer, a disk controller 108, a picture 
cache memory 109, a video digitizer 110, a display pro- 
cessing unit 112, and a display processing control 114. 
The controller 22 is further adapted to receive inputs 
15 from the control panel 70 through an interface unit 
120. As noted above, the controller 22 is in direct 
communication with the various VTR interfaces 24, 26, 
28, and 30 as well as with video port interfaces 122, 
124, and 126. (Interfaces 122, 124 and 126 operate m 
20 response to controller 22 for controlling external 
video equipment, for example external VTR's.) The 
■ controller 22 also operates video routing circuitry 
130, 132, and 134, and a video effects switching cir- 
cuit 136. In the illustrated embodiment, the 

„ ^r^y-at-^s with a system clock generator 
25 controller 22 operates witn a =jr 

140 for system signal synchronization. 

According to the illustrated embodiment, at 
the beginning of a composing session, controller 22 
operates in a default mode, which is an automatic 

30 segmenting mode, for dividing "raw video" source 

material into plural segments. The illustrated appara- 
tus is thus designed to effect a segmentation of the 
source material according to a predetermined method and 
sequence. This segmentation process is described above 

35 as a periodic sampling process. On the other hand, as 
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noted above, it is also desirable for the operator to 
review the source material quickly and roughly and 
indicate his initial feel for the divisions between 
segments. This operator controlled segmentation func- 
tion can be implemented in any arbitrary manner, and is 
described in detail below. 

Controller 22 is further responsive to the 
operator console for providing a storyboard output to 
printer 106. The storyboard output includes a sequence 
of labels, generally at a program bin level, which 
describes the flow of the story. In addition, if tex- 
tual material had been entered from the keyboard 104 
with respect to any segment label, that material is . 
also printed on the storyboard. The operator/editor 
can then use the storyboard as a "hard copy" guide and 
aid during the composition process. 

Passive D is play Op eration 

Referring to Figures 2-7, in accordance with 
the illustrated embodiment of the invention, each 
passive display screen 42, 44, 46,..., 68 is a 3.7 inch 
monitor on which a relatively low resolution, 128x120 
picture element (pixel) raster is displayed. In the 
preferred embodiment of the invention, the raster has 
sixteen levels of gray scale corresponding to four bits 
of information. In other embodiments of the- invention, 
more or less resolution, both spatially and in gray 
scale, or color, can be employed. 

The digital display data, which represents 
the pictorial labels, is generated by the video digi- 
, tizer 110 under control of the controller 22. 

Digitizer 110 receives analog video input data from the 
video routing circuitry 130 over a line 143. The video 
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- digitizer, which includes a fast A-D converter and a 
two picture capacity random access memory, stores the 
digitized video, digitized to four bits, for later pre- 
sentation over the digital bus either to the display 

5 processing unit 112, to a disk storage 146, or to the 
cache memory 109. Controller 22 controls the flow of 
digital data from the video digitizer, disk, or cache 
storage to the display processing unit and is capable 
of dynamically updating the pictorial labels displayed 
at the console 12 at a rapid rate, for example, twenty- 

10 four per second. 

The digitizer, through its computer inter- 
face, receives instructions from controller 22 over the 
computer bus 107. The digitizer is fast enough to grab 

15 a frame on-the-fly from an ongoing stream of video 

information over line 143. The interface can therefore 
be instructed by the controller 22, upon recognition of 
the time code location, to trigger upon recognition of 
the next vertical interval pulse, and the video or 

20 video segment associated therewith will then be digi- 
tized and stored. The frame time code is used by the . 
apparatus to identify the frame. The digitizer can 
also digitize a frame displayed in the. freeze mode of 
VTR operation, read its time code, and store the data 

25 for future use by the controller. 

The video output from the video routing cir- 
cuitry 130 to the video digitizer is selected and dic- 
tated by the signal levels from the controller 22 over 
lines 142. The video routing circuitry 130 is an 
30 EXCLUSIVE OR routing circuitry which takes one of the 
video inputs (from the VTR's 14,..., 16,..., 18,..., 
20, from video input ports 275, 276, and from routing 
circuit 132) and provides that selected input to the 
video digitizer over line 143. The selected video 
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input signal can thus be digitized to become available 
to be displayed as pictorial label. The video input 
an<T frame selection process is at least partially 
controlled, as described below, by the operator/editor 
5 at control console 12. 

Controller 22 has associated with its disk 
controller 108, the high speed disk storage device 146. 
Storage device 146 can be employed, for example, to 
store all labels of interest so that they can be output 

10 to the display processing unit 112 as needed. Since 
each illustrated passive display screen requires only 
eight kilobytes of information, the disk controller and 
disk storage are fully capable of changing all of the 
displays stored by the display processing unit 112 

15 within a short time duration and therefore provide a 
great flexibility to operation of the pictorial label _ 
presentation. 

Even though the disk controller and disk 
storage can operate with access speeds. on the order of 

20 ten milliseconds, the retrieval of labels from dif- 
ferent sections of the disk can result in a non-uniform 
rate of change for the passive displays. The apparatus 
therefore employs the picture cache memory 109, a high 
speed- solid state memory attached to the controller bus 

25 107, for maintaining a fast uniform label change rate. 
The cache memory typically has sufficient storage capa- 
city for sixty label pairs and has an access time on 
the order of tens of microseconds which is signifi- 
cantly faster than the access 'time for disk storage 

30 146. The cache memory operates under the control of 
controller 22 and receives new label pairs, as needed, 

from the disk storage 146 under control of controller 
22. 
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The display processing unit 112, referring in 
particular to Figure 4, has two identical row pro- 
cessing circuits 150, 152 for driving, respectively, 
the top row of passive displays and the bottom row of 
5 passive displays. Each row processor 150, 152 connects 
to the data bus 107 and to the display processing 
control 114. 

The row processors are identical and hence 
only row processor 150 is described. Referring to 
L0 Figure 5, the illustrated row processor 150 has a 
plurality of digitized picture generators 154, 155, 
156,..., 161. The digitized picture generators are all 
identical and hence only picture generator 154 is 
described in detail. Each illustrated picture genera- 
L5 tor has two picture memories 162a and 162b, a four bit 
multiplexor 163, a digital adder 164, an offset 
register 166, a digital-to-analog converter 168, and a 
memory address counter 170. The output of picture 
generator 154, which is an analog video signal over a 
20 line 172, connects to each of a plurality of analog 

multiplexing devices 174, 176, 178, 180, 182, 184, and. 
186. The output of each of the multiplexing devices 
connects to a respective video amplifier 188, 190, 192, 
194, 196, 198, and 200; and the output of each 
25 amplifier drives a corresponding passive display for, 
in this case, the top row of video passive displays m 
the two row array shown in Figures 1 and 3. 

The memories 162a and 162b of each picture 
generator receive picture representing data from the 
computer bus 107. Each digitized picture generator has 
in at least one of its memories 162a, 162b, .written 
under the control of controller 22, the data which 
represents a video picture to be displayed on a passive 
display screen. The illustrated digital picture has 
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120 rows, each row containing 128 picture elements 
thereacross. (As noted above, each picture element has 
six'teen possible gray levels, meaning that four bits of 
information are required for each picture element.) 

5 A memory 162a or 162b is read sequentially by 

stepping the memory address counter 170. Memory 
address counter 170 connects to both memories 162a and 
162b. A memory select signal over a line 201, from the 
display processing control to digital multiplexor 163, 
10 selects one or the other of the memories for reading, 
leaving the memory not selected available for receiving 
new data. Multiplexor 113 applies the digital output 
of the addressed digital picture memory location of the 
selected memory to digital-to-analog converter 168 
15 which converts it to an analog signal. Horizontal and 
vertical synchronization pulses are provided to each 
picture generator from a common synchronization timing 
circuit 187 and are mixed with the output of the pic- 
ture generator to provide full synchronization between 
20 all of the video displays. Each memory address counter 
170 receives clock pulses from the common timing cir- . 
cuitry 187 so that all eight picture generators are 
completely synchronized on a pixel-by-pixel basis. 
Each passive video display screen receives its picture 
25 output from a respective one of the analog multiplexing 
devices. Therefore, each passive video display can 
receive the analog signal output of any of the digital 
picture generators. The analog multiplexing devices 
operate in accordance with signals over lines 187a 
received from the display processing control 114. 
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The operation of the row processor can be 
illustrated as follows. Assume that video display 42, 
at the left edge of the upper row of passive display 
screens, is displaying the picture stored in picture 
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generator 154; that video display 46 is displaying the 
picture stored in picture generator 155, and so on, so 
tha^ video display 66 is displaying the picture stored 
in picture generator 160. The picture stored in the 
digitized picture generator 161 is not displayed and a 
new picture, to be scrolled, from the right, into the 
top row of the screen array, is written into its 
raemory. Assume now that in accordance with the opera- 
tion of control wheel 74, as will be described later, 
5 the new picture is to be shifted into the top row from 
the right, that is, scrolling (or picture shifting) is 
effected to the left. This is accomplished by 
directing the analog output which generates the pic- 
ture, from picture generator 161 to passive display 66, 
5 and correspondingly directing the analog output of 

generator 160 to display 62, the analog output of pic- 
ture, generator 159 to display 58,. and so on, so that 
the analog output from picture generator 154 is no 
longer displayed on any of the passive display screens. 
0 The redirection of the picture generator analog outputs 
from screen to screen is accomplished by controlling 

the analog multiplexors 174, 176 186, from display 

processing control 114. In this manner, a picture can 
be moved from one screen to another; and in fact, in 
, 5 accordance with the embodiment just described, pictures 
are scrolled, as a whole, from one screen to the next 
in what would appear to the viewer to be a relatively 
"jerky" instantaneous change whereby all screens change 
simultaneously. 

30 Alternatively, it has been found desirable, 

in connection with the passive display screens, to 
scroll the video "smoothly" (hereinafter referred to as 
"smooth scrolling") from one screen to the next, 
smooth scrolling refers to that motion wherein it 

35 appears as though the pictures were frames of a con- 



QMPI 
/a, W1PO 



WO84/02606 



PCT/US83/01955 



-42- 



tinuous imaginary film strip which was moved, at a 
constant rate, behind openings corresponding to the 
pas-sive display screens (in the described example, the 
film is moved to the left). Thus, as smooth scrolling 

5 occurs, for a. spatial extent corresponding to one 

complete picture, there is a time duration during which 
image movement occurs to the left, and further during 
which a single picture image is split between two adja- 
cent screens. In the example herein, the image disap- 

10 pears -at the left edge of a display screen and appears 
at the right edge of the next adjacent screen (if any) 
to the left. 

In accordance with the present embodiment, 
smooth scrolling takes place in a sequence of eight or 

15 sixteen equal steps, each step lasting one television 
field (that is, one-sixtieth of a second). In other 
embodiments, greater or fewer steps can be used. The 
detailed discussion below relates to operation and 
control of the circuitry for video display screen 42. 

20 The other displays screens are controlled and operate 
in a similar fashion. 

Consider now, with reference to Figs. 1 and 
5, as an illustrative operating example, smooth 
scrolling to the left, in sixteen equal steps, wherein, 

25 initially, screen 42 displays the picture stored in 
picture generator 154, screen 46 displays the picture 
stored in picture generator 155, ... , and screen 66 
displays the picture stored in generator 160. 
Initially screen 42 displays one complete video pic- 

30 ture. Functionally, after the first "step" in the six- 
teen step smooth scrolling process, (a) the leftmost 
one-sixteenth of the picture from the digital picture 
generator 154 disappears from view in display screen 
42; (b) the remaining fifteen-sixteenths of the picture 
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are displayed on screen 42 starting at the left edge of 
the screen; and (c) at the rightmost one-sixteenth of 
the- screen 42 displays the leftmost one-sixteenth of a 
new picture from picture generator 155. 

5 The resulting split image presentation is the 

result of a combination of two separate effects. The 
first effect is to add an. off set count to the output of 
the memory address counter for all of the picture 
generator circuits. This procedure, in effect, rota- 
10 tes, in wrap-around fashion, each horizontal line of 
the display. This first step is implemented as 
follows. in the illustrated embodiment, each four bit 
memory word, representing a pixel, is addressed by a 
fourteen bit address count, the seven least significant 
bits representing the horizontal position on the 
display screen, and the seven most significant bits 
representing the vertical position .on the screen. The 
address "0" corresponds to the top leftmost pixel on 
the screen. Therefore, an offset count equal to eight 
picture elements (128 picture elements divided by six 
teen equal steps) from the offset register 166 can b. 
added to the memory address count output of counter 170 
to offset the picture horizontally and in effect to 
move (wrap-around) the otherwise first displayed one- 
25 sixteenth of the picture (the leftmost portion) to the 
rightmost one-sixteenth of the screen. This offset is 
implemented by placing a count of eight in the offset 
register 166. The output of the. offset register is 
added by digital adder 164 to the seven least sig- 
30 nificant bits (the horizontal position bits) of the 
position count. Thereafter, every further increment 
(of eight) to the count in the offset register moves 
the rightmost edge of the stored display further to the 
left by one-sixteenth of a horizontal picture line. 
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In the illustrated embodiment, when the off- 
set is "eight", a horizontal address count input to the 
memory 162 reaches the right edge of the picture stored 
in the digital picture generator when the displayed 
5 line is fifteen-sixteenths of the distance across the 
display screen. The horizontal address input to the 
memory at this juncture is, in binary: ••1111111". The 
next address count from the memory address counter 
causes the digital adder 164 to overflow. The carry 
10 bit from the adder however is not connected to the 

memory address counter and therefore the displayed pic- 
ture "wraps-around" to its stored leftmost portion and 
the new horizontal address count is, in binary: "0". 
The left one-sixteenth of the stored picture line is 
15 then, absent any other manipulation, displayed at the * " 
rightmost one-sixteenth of the passive display screen, 
such as screen 42. 

Since, in this embodiment, each digitized 
picture generator is displaced by the same offset count 
20 and operates synchronously with each other generator, 
all of the passive displays reach the "wrap-around- 
point simultaneously. It is at this time, when all 
displays reach the "wrap-around" point, that the second 
effect or process step of the smooth scrolling imple- 
25 mentation takes place. At the time when the 

"wrap-around" point is reached, all of the analog 
multiplexors are switched to a new (the next "higher" 
in this example) picture generator. That is, at the 
"wrap-around" point, display 42 begins to receive its 
30 video from picture generator 155; display 46 from 
generator 156, etc., display 66 receiving its video 
from generator 161. Thus the rightmost one-sixteenth 
of the picture displayed on screen 42 is the leftmost 
one-sixteenth of the image stored in digitized picture 
35 generator 155. The screen 66 thus begins to display a 
new picture (from generator 161). 
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The generation of the second step of the 
-smooth scroll" is effected by incrementing the offset 
registers 166 of all of the picture generators to a 
next higher incremental count i.e., in the illustrated 
5 sixteen step embodiment to a count of sixteen. Thus, 
the video on each screen begins at the second incremen- 
tal step into the stored picture. This corresponds to 
one-eighth of the sixteen horizontal picture element 
distance in the sixteen step embodiment. The 
10 multiplexors start each horizontal line in the same 

"original" state (display screen 42 receiving its video 
from generator 154, for example), and then switch to a 
next picture generator seven-eighths, i.e., fourteen- 
sixteenths, of the distance across each horizontal 
15 line. This spatial distance corresponds to the wrap- 
around point. 

The remaining fourteen steps required to 
complete a sixteen-step smooth scroll are a straight 
forward extension of this progression. Thus, the off- 

20 set registers increment to a new count, in the 
illustrated embodiment, once each frame. The 
multiplexors switch twice for each horizontal picture 
line, (first at the "wrap-around" point and again at 
the end of the line). At the rightmost screen of the 

25 linear row array, in this example, there is "scrolled" 
into view the picture stored, but previously not 
displayed, in the "extra" picture generator, i.e., 
generator 161. 



30 



If scrolling toward the right, for example, 
in eight steps, is called for by clockwise movement of 
control wheel 74, the same procedure detailed above is 
followed, except that the stepwise movement occurs 
reverse order. Thus, the analog multiplexors first 
select the "new" picture being scrolled onto a screen, 
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and switch at the wrap-around point to the old image. 
Similarly, a first offset of, in decimal, "112" is 
entered into offset register 166, and the offset 
register is decremented by sixteen each vertical frame 
5 time. (Eight steps correspond to a movement of sixteen 
pixels each step.) Correspondingly, in other embodi- 
ments of the invention, more or fewer "scrolling" steps 
can be chosen to provide a greater or lesser perceived 

smoothness of motion or speed of movement. For 
10 example, if four steps were desired, an offset value of 

thirty-two (incremented by thirty-two each step) would 

be entered in the offset register for a left hand 

scroll. 

An advantage of smooth scrolling, aside from 
15 the psychological advantage of a less confusing 

display, is found when the picture data base contains -a 
large number of label pairs. Then smooth scrolling to 
the right or left gives the effect of viewing a summary 
of a movie film during film editing. Also, however, 
20 stepping the pictures instantly from display screen to 
display screen (i.e. using the analog multiplexors with 
an offset of zero) produces. the effect, if only one 

'„i flU .j Q f watching a conventional 

display screen were viewed, or wdLLiuuy 

moving picture. 

It is important to note that since each ana- 
log multiplexor 174, 176 186 is independently 

controlled by the display processing control 114, it is 
possible to scroll images of some of the displays while 
leaving other displays unchanged. For example, it is 
possible to leave the pictures on displays 42, 46, and 
50 unchanged and to scroll the pictures on displays 54, 
58, 62, and 66 to the left thereby "shifting out" the 
picture originally on monitor 54. This feature is 
implemented by maintaining the offset registers for 
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those digitized picture generators being displayed on 
monitors 42, 46, and 50 set at "zero" (and correspon- 
dingly not switching the associated analog 
multiplexors). The other registers and associated 
multiplexors are "cycled" as described above. Thus, 
the analog multiplexors and the offset registers 166 
be independently controlled by the display 



can 

controller 114. 
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In accordance with the preferred embodiment 
10 of the- invention, there is further featured, using the 
smooth scrolling technique, a method for substantially 
continuous scrolling in order to locate a particular 
segment of the video. In accordance with this method,., 
a control wheel 74 or 76 is rapidly rotated a plurality 
of times to effect smooth scrolling. Since an operator 
can rotate the wheel at a relatively high rotation . 
speed, that is, many detents per second, when compared 
to the typical speed of smooth scrolling, the processor 
22 stores the number of detent positions passed during 
20 the rotation of the control wheel and implements the 
smooth scrolling procedure to move the label pairs 
displayed on the passive display screens by that number 
of screen positions, to the right or left. The opera- 
tor is then in a position to view the label pairs 
25 passing along the display screens. If, as these labels 
pass by, the operator notes a position at wh.ich he 
wishes to terminate scrolling, he need only rotate the 
control wheel one detent position in the opposite 
direction. The controller 22 recognizes this wheel 
30 movement as a command to stop the smooth scrolling pro- 
cess. The apparatus then reverts to a normal end of 
smooth scrolling condition as if the smooth scrolling 
had come to a natural termination. 

in the absence of early termination of smooth 
35 scrolling as outlined above, the. controller 22 con- 
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tinues the scrolling until the number of positions of 
cement along the passive display screens equals the 
nunfber of detent positions of movement by the control 
wheel. At that time, the passive display screen pre- 
sentation returns to its normal and stationary one 
screen-one video frame presentation. 

With further reference to Figures 2 and 5, as 
noted above, the picture generator memories 162a and 
162b connect to the computer data bus 107 to receive 
the picture data stored- therein. Although the source 
of the picture data can be either the picture cache 
memory 109, the video digitizer 110, or disk storage 
146, according to the preferred embodiment of the 
invention, the picture cache memory supplies the image 
data to the data processing unit. As noted above, this 
enables a more uniform presentation which is par- 
ticularly helpful during the smooth scrolling procedure 
wherein the two groups of memories 162a and 162b are 
reloaded essentially during an eight or sixteen field 
time interval (one at the beginning of the interval and 
the other at the end)" in order to maintain a con- 
tinuing, smooth movement. The memory loading takes 
place under the control of controller 22. Controller 
22 provides the necessary address information to the 
picture cash, memory and the destination information to 
the display processing unit for enabling a direct 
transfer of data from the picture cache memory to the 
appropriate storage in digital picture memory 162a or 
162b. Controller 22 can also implement similar data 
transfers between the video picture digitizer and the 
disk controller and storage on the one hand, and the 
digital picture memories 162a and 162b, on the other. 

The row processors 150, 152 in combination 
with the display processing control 114 can also be 
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employed for a film style presentation, as described 
below, during the trim and splice operating modes. In 
the" splice mode, for example, a horizontal display of a 
splice can be effected by independently scrolling the 
top and bottom rows of displayed images in accordance 
with the respective rotational movement of control 
wheels 7 4 and 76. The top row corresponds to the 
-from" video segment and the bottom .row corresponds to 
the "to" video segment. By moving the from and to 
segments relative to one another, a temporal view of 
the splice can be achieved. The independent movement . 
of the images is created by independently controlling 
the analog multiplexors and offset registers for each 
row of passive display screens. 

In accordance with one particular embodiment 
of the invention, textual display material, associated 
with a label and its corresponding segment, can be 
added to the display data stored in the display pro- 
cessing unit 112. The text can then be made available 
for viewing on the passive dispaly screens as follows. 
The display monitor screens are rectangular, and since- 
the array storage is generally square (that is, for 
example, 128x128 elements) , there becomes available a 
small strip of the display storage corresponding to a 
horizontal edge strip. The horizontal strip, which can 
be at the bottom of the screen, does not normally 
appear visible to the user. 

The controller 22 can then operate, if 
* . desired, to insert into the displayed image the 

available textual material. This material is inserted 
below the pictorial label, and correspondingly, an 
operator can, for example through the keyboard or - 
through a switch provided in association with each 
label screen, move the display in a vertical direction. 
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Thus, in one position a portion of the pictorial label 
is -cut off (at the top of the screen) and a text 
message is available at the bottom of the screen. In 
the other position the full pictorial label is 
displayed while the message is cut off. Other forms of 
display can also be employed, if desired, for example 
an overlay of textual material on the display monitor. 
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Referring to Figures 3 and 6 , the illustrated 
console 12 has the active main display screen 32 and 
the four subsidiary active display screens 34, 36, 38, 
and 40. The active display screen 32 is preferably a : .. 
color monitor. In the illustrated embodiment, these 
screens receive analog video signals from the video 
15 routing circuit 134 and video effects switcher 136. . 
These circuits, operating under the control of 
controller 22, select video signals from among the real 
time video signal outputs of the video tape recorders, 
the video input ports, and the reduced resolution 
displays from the display processing unit 112. The 
routing circuit 134 receives the processing unit video 
over lines 202, of which there is one line for each ) 
display screen. The routing circuit 134 and video 
effects switcher 136 display the video they receive on 
the various active display screens. Thus, in the 
illustrated embodiment, those active displays which 
require the display of a single frame, such as a pic- 
torial label, can employ either the analog video from a 
VTR operating in a freeze frame mode or the analog 
signal over lines 202 derived from a low resolution 
digital raster stored in a memory of the display pro- 
cessing unit. 

In the illustrated embodiment, under the 
direction of the controller 22, up to six video inputs 
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to circuitry 134 are selected for display on the five 
available monitors. Monitors 34, 36, 38, and 40 each 
connect to a generally, but not necessarily, dxfferent 
one of the video output lines available from video 
5 routing circuit 134. The main color monitor receives a 
video output from video effects switcher 136 over a 
line 203. Video effects switcher 136, under the 
control of controller 22, selects one or the other, or 
causes a transition from one to the other, of the video 
10 input signals over lines 204 and 206, to be its output 
video signal. In this manner, under control of 
controller 22, the monitor 32 can display, for example, 
a continuous loop presentation of a video segment (as 
discussed further below) or a continuous loop presen- 
15 tation, including the transition, between two video 

segments. The routing circuitry 134 and video effects 
switcher 136 can also be employed, for example, to 
blank all monitors except the main color monitor and to 
display on it the output of a single video input to 
20 circuitry 134. 

in the illustrated embodiment of the inven- 
tion, video routing circuit 134 and video effects 
switcher 136 are commercially available devxces 
designed to provide the necessary video routing and 

25 "effects" functions. In effect, circuitry 134 provides 
a routing function which chooses from among the various 
input signals for display of an output signal. For 
example, circuit 134 can employ seven multi-pole video 
switches with each being dedicated to one video output. 

30 All of the selection circuits receive the same video 



inputs 



PCT/US83/01955 

WO84/02606 



-52- 



10- 



15 



20 



25 



30 



Video Input/Outp ut Record in« 

Referring now to Figure 7, the video routing 
circuitry 132, under control of controller 22, directs 
one or more of the video signals input it receives over 
lines 260, 262, and 264, to one or more of the video 

tape recorders 14, 16 20, to the video digitizer, 

and/or to a video output port 224 (the latter for deli- 
very to, for example, an external device such as a 
video recorder which is not associated with the present 
embodiment of the invention). The video input to the 
routing circuit can be available from a video tape 
recorder 266, which has associated with it a video 
interface 268, from a video input port 270, or from the 
system clock generator 140. Video interface 268 
receives clock information, as described in detail 
below, from the system clock generator 140 and control 
signal information from the controller 22. Video input 
port 270 receives video over a line 272 from an exter- 
nal source, and operates under the control of the video 
port interface 126. The video input port 270 can 
receive a video signal over line 272 from, for example- 
a video camera. The video information over line 262 
can be combined with clock identification signals from 
the system clock generator 140 over separate line 260. 
The system clock generator 140 provides SMPTE time code 
signals for use in the composing process. 
Alternatively and preferably, in the illustrated em- 
bodiment, the capability of providing SMPTE time code 
data is distributed among the interface circuits 24, 26 

and clock generator 140 provides master clock 
timing for the apparatus. 

The video routing circuitry 132 thus connects 
a selected video signal from lines 260, 262, 264, and 
273 to either a video output port 274, controlled by 
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the video port interface 124, and/or to any or all 
video tape recorders for recording. And, if necessary, 
the" time code location over lines 260 from the clock 
generator 140 is also available for writing onto the 
5 video tape recorders. This occurs, for example, if the 
video signals do not already contain the time code 
information. 

The video routing circuitry 132 can employ 
commercially available devices, and operates as an 

10 EXCLUSIVE OR gate with respect to the video inputs and 
as an INCLUSIVE OR gate with respect to directing video 
output. Thus, any video input can be placed on any or 
all of the output lines. The operation of the routing 
circuit 132 is, as noted above, under the control of 

15 the controller 22. The circuitry therefore in effect 
places a video input signal (including time code infor- 
mation if needed) on the output line or lines as 
desired for specified operation. 

Video Tape Recorder Interf ace Operation 

20 As noted, a video tape recorder interface is 

• associated with each video tape recorder. This is, in 
essence, a smart terminal. Referring now to Figure 8, 
a typical video tape recorder, for example recorder 14, 
. and its associated interface 24 are shown in greater 
25 detail. Each video tape recorder has a video input 

line 280, a video output line 282, a plurality of sta- 
tus output lines 284, a plurality of controlling input 
lines 286, a power output line 288, and a clocked input 
line 290. According to the illustrated embodiment of 
30 the invention, the commercially available video tape 
recorder has circuitry for enabling the output of the 
video tape recorder to be RF modulated for display on a 
. standard television channel. This is not necessary 
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according to th. P-ferred embodiment of the 

wherein th. video displays ^ ^ ^t 

the RF modulator output required for typical 

television. Therefore, according to the 

embodiment of the invention, the RF output section of 

the video tape recorder is disabled and an 

-card- as described below, is mounted on the recorder. 

According to the illustrated embodiment, the 
VTR interface 24, which is identical to all other video 
0 tape recorder interfaces employed in the ^-"^ 
' embodiment, has a microprocessor control ™^°° 22 
which receives digital instructions from controller 
through an input/output network 302. This provides a ., 
distributed processing structure and allows the 
LS controller 22 to act more as a remote manager over what 
can be multiple simultaneously occurring operations. . 

- - a „<«, rhe microprocessor are a read-only 

Associated with tne ^" u f LU 

memory 304 and a random-access memory 306 _"~rd», 
to the illustrated embodiment of the ^*™-J C °^ 
, 0 cesser 300 is a 280 device manufactured by Zilog. The 

300 receives status data input from the video 
processor 300 receiv ^ 

tape recorder through a time code reaaer a 

status decoder. 310. VTR status decoder 310 

includes a VTR control circuitry 312 which enables the 

, nn +. 0 rQ ntrol the operation of the 

->e microprocessor 300 to control f 

25 The microprocessor 300 also has 

video tape recorder. The microti. w 

access to the system clock through a system clock 
counter 314. The system clock counter receives an _ 
input from the system clock generator 140 over a line 

30 316. 

in operation, the microprocessor control 300 
receives operating instructions from the controller 22. 
The operating instructions include, for example, a tape 
start location, a tape start time, and a tape end loca- 
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tion for the video tape recorder. The microprocessor 
control positions the video tape recorder in response 
witfi these operating instructions. The location of the 
video tape is indicated by the output of the time code 
5 reader, which uniquely identifies each frame on the 
tape. Operation of the video tape recorder can then 
take place in accordance with the system clock 
available through clock counter 314. When required, 
data can be written onto tape., under control of the 

, nn ari j ran include the clock input for 
10 microprocessor 300/ and can m^^ uuc 

providing the time code information. 

According to the preferred illustrated em- 
bodiment of the invention, one VTR interface writes an 
internal time code designation in addition to the SMPTE 

15 time code which is normally associated with each video 
frame when it is originally generated. Thus, as source 
material is being recorded on a plurality of VTR's, one 
interface for example interface 24 associated with VTR 
14, writes an internal time code in association with 

20 each frame. The internal time code is sequential and 
the now modified video being recorded on VTR 14 is also 
directed by controller 22 to all of the other recording 
VTR's through video routing circuits 134 and 132. 
Thus, VTR recording is synchronized so that a frame has 

• ^ ,.u fl „ u ifh an internal time code designation 
25 associated therewitn an in«" lQJ ; 

which is the same on all recordings. 

Further, the internal time codes are recorded 
sequentially on the video tape and provide an easy pro- 
cedure for accounting for time durations in response to 
30 commands which controller 22 generates. Thus, for 

example, there are always eight frames between frames 
-one" and "ten". (The source material comes from dif- 
ferent sources and is often prepared at different 
times. Hence, inevitably there are gaps in the 
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sequence of source generated time codes when the dif- 
ferent source generated materials are sequentially 
recorded on one tape. ) Further operation of the video 
tape recorder is in a standard manner as is well known 
5 to those skilled in the art. 

General Operation o * fhe Apparatus 

In operation, the illustrated composing 
apparatus is controlled solely from the control console 
and in particular from the control panel 70 by the 
10 control wheels 74, .76, control keys 78, 79,..., 99, and 
control levers 100, 101, 102, 103, (see Fig. 3). The 
two control wheels 74, 76 are hand operated, rotary 
controls which allow the manipulation and selection, 
' for example of earlier or later pictorial labels in the 
15 sort mode of operation, by counterclockwise (for later) 
' and clockwise (for earlier) rotational movement respec- 
tively. These wheels can also effect change of the 
beginning and end of a segment (the trim mode of 
operation) or the beginning and end of a transition 
20 between segments (the splice mode of operation). Thus, 
the wheels 74, 76 in the illustrated embodiment are 
active during the sort (wheel 74 only) , trim, and 
splice modes. 

The wheels can be constructed of, for 
example, wheels, three inches in diameter and three- 
quarters of an inch high and preferably have a finger- 
sized indentation 320, 322, on their upper surface. 
The illustrated wheels have thirty detent positions for 
each complete revolution and provide a signal through 
interface 120 to controller 22 for each detent move- . 
ment. The interpretation of one detent of movement 
depends upon the operating mode. For example, in 
either the trim mode or the splice mode, each wheel 
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operates to aide in editing the segment represented by 
a selected active pictorial label, and one detent of 
movement corresponds to one frame of video. In the 
sort mode, however, a movement of one detent position 
5 corresponds to the shift of all label pairs one posi- 
tion to the right or left on the passive displays. 

t 

As outlined above, the composing apparatus 10 
operates in a number of operating modes. Entry of the 
apparatus into and out of the various operating modes 

10 is the function of control keys 78, 83, and 89. Each 
key operates a mechanical switch which signals through 
interface 120 to controller 22. Control key 83 places 
the apparatus in the sort or composition mode. 
Depressing this key, to enter the sort mode, allows the 

15 operator to thereafter move and manipulate the label 

pairs appearing on displays 42, 4 4 68. Thereby, 

the segments represented by the label pairs can be 
pulled and inserted, deleted, arbitrarily inserted in 
various positions, etc. 

20 After an operator has organized the sequence . 

of segments into a desired order, depressing the trim 
key 78 places the composition apparatus in the trim 
mode of operation. In this mode of operation, the 
beginning and end of a segment can be changed, to 

25 thereby shorten or lengthen the frame sequence, under 
the control of, and by rotational movement of, the 
control wheels 74 (beginning) and 76 (end). The 
segment however is not actually "trimmed" until both 
accept key 88 and accept key 99 are simultaneously 

30 depressed. In the trim mode, the labels identifying 
the beginning and end of the selected segment are 
displayed on screens 34 and 36 respectively. 
Simultaneously, the selected segment appears in a con- 
tinuous loop fashion (with a "break" between the end of 
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the segment and the beginning of the next display of 
the segment as described more fully below) on the mam 
screen 32. As the beginning and end of the segment are 
adjusted respectively by rotating control wheels 74 and 

5 76, the resulting changes in the segment composition 
are substantially instantaneously reflected on screens 
34 (which displays the first frame of the segment) and 
36 (which displays the last frame of the segment). By 
rotating the wheel 74 or wheel 76 back and forth, there 

10 appears in the corresponding display 34 or 36 the 
••action" portrayed at the beginning or end of the 
segment. By carefully controlling the rocking motion 
of the control wheel, the operator can accurately. "zero 
in" on the exact frame at which the segment is to 

15 either begin or end. This technique, designated 

"action scrolling", enables precise decisions to be 
made with regard to the beginning and end of the 
segment. 

It is further important to recognize that a 
20 single 360- rotation of the control wheel corresponds 
to thirty detent positions in the illustrated embodi- . 
ment and hence equals thirty frames or one second of 
video in the trim and splice modes of operation. It is 
therefore convenient for the operator, without 
25 reference to actual time measurement or time code 

signals, to accurately adjust the duration of the video 
segment. In addition, however, to further aid the 
operator, the apparatus provides during the sort and 
trim modes of operation, on screen 40, the time dura- 
30 tion of the segment being edited. The time duration 

for the segment defined by the label pair on screens 34 
and 36 is generated by the controller 22. 

Once the operator is satisfied with and 
finalizes the length of the segments, the splice bet- 
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ween successive segments can be changed, if desired, 
from the abrupt cut, i.e., the default option, which 
typically occurs between segments. Depressing key 89 
places the apparatus in the splice mode of operation. 
5 in this mode of operation four different splices can be 
achieved: key 90 provides for a dissolve, key 91 for a 
wipe, key 92 for a soft cut, and key 93 for an 
"ordinary" cut (the default option). 

As noted above, the illustrated control con- 
10 sole includes two pairs of levers 100 and 101, and 102 
and 103. One pair is adjacent each control wheel for 
convenient lever operation with the hand still in con- 
tact with that wheel. All of the. levers have seven 
positions in the illustrated embodiment, although, it 
15 may be desirable in other embodiments of the invention 
to provide for more or fewer discrete positions or for 
a continuous adjustment or movement for one or more of 
the levers. Lever 100 controls the position of a 
cursor: the illustrated cursor has an upper and a 
20 lower component for denoting a label pair on the 

passive displays. The cursor position corresponds to . 
the illuminated ones of illumination elements 3 24 which 
appear (in Figure 3) above the top row of passive 
displays and below the bottom row of passive displays. 
25 Each passive display thus has associated therewith a 

cursor illumination element 324. The elements 324 thus 
indicate the location of * the upper and lower components 
of the cursor. Movement of lever 100 generally causes 
the cursor components to move together from, for 
30 example/the display screen pair 50, 52 to the display 
screen pair 54, 56. The display screen pair selected 
by the cursor is that display pair which, in the sort 
and trim modes, designates the segment to be "looped 
on main screen 32 and which designates the labels to be 
35 displayed in screens 34 and 36. In the splice mode 
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however, the upper cursor component is not above the 
lower cursor component. Rather, the upper component is 
offset by one position to the right, and the cursor 
bottom component thereby indicates the ending label of 
a first segment and the top component indicates the 
beginning label of a second segment. There are in 
addition other embodiments of the invention, as will be 
discussed below, wherein the cursor control and posi- 
tion vary further. 



10 



Lever 101 controls the speed of a splice. As 
noted above, lever 101, in the illustrated embodiment, 
is a seven position switch and provides splice speed as 
a discrete operating parameter. In other embodiments 
of the invention it may be desirable to provide a con- 
15 tinuous splice speed variation. It is important to 
note also that the speed of the splice can be varied 
during the transition itself by movement of lever 101 
as the splice proceeds. 

Lever 102 controls the bin (or level) from 
which the labels displayed on the passive display 
screens are selected. As noted above, there are, in 
the illustrated embodiment, seven different bins (or 
levels). Movement of lever 102 provides a substan- 
tially instantaneous change of bin (or level). 
25 Movement of the lever to the right, corresponds to 

movement to a higher bin (or level). Movement of lever 
102 to the left, corresponds to movement to a lower bin 
(or level). 
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Lever 10 3, in the illustrated embodiment, 
controls the manner of selecting and recording source 
audio information during the composing process. 
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Particular Operation of th e Apparatus 
Input Mode 

Prior to editing any source material/ that 
source material must be properly input to the composing 
5 apparatus. The source material can be, for example, an 
existing video tape or live video material received 
directly from a video camera. In either instance, 
referring to Figure 7, the source material is routed, 
by video routing circuitry 132, to at least two or more 
10 of the video tape recorders. The primary goal of the 
video tape recorder storage is to make each segment of 
the video source material available on at least two 
separate recorders and preferably ten or more. This 
allows access times comparable to those obtainable with 
15 optical disk media and, as described below, facilitates 
the display of the segments during the various edit 
functions'. As a result, in the illustrated embodiment, 
if the amount of source material has a total running 
time of less than four and one-half hours (a standard 
VTR tape cartridge), the source material is duplicated 
on each and every video tape recorder in the system. 
This simplifies the input operation and decreases the 
apparatus response' when playing a sequence of segments 
in real time. 

The controller 22 controls the routing of the 
source material through routing circuitry 132. It also 
controls, in response to control information input 
through the keyboard 104, the method in which the 
source material is segmented and in which label pairs 
30 are generated therefrom. Thus, as noted above, the 
source materialman be automatically marked for sub- 
division at. a periodic interval, for example every 
second, specified by the editor. Alternatively, as 
noted above, the editor can. specify the interval 
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marking as the incoming source material is being 
received. In the latter instance, the controller 22, 
in response to activation of the mark key, subdivides 
the incoming material* 

5 in either instance, during the receipt of 

ma . ar i a l the illustrated controller 22 collects 
source material r tue xxj. v*^ 

the label pairs for each segment being recorded. For 
each segment, the controller 22 generates an "IMAGE" or 
image pair which includes a digitized snapshot of the 

10 frames, typically the first and last frames of the _ 

segment, which are employed as the label pair for the | 
segment. Further this IMAGE or image pair includes the 
precise location of the segment both in the external 
medium used for input (if the external medium is tape)' 

15 and in the apparatus video tape recorders. The IMAGES 
are stored on magnetic disk for later retrieval as 
required for display and generation of the storyboard. 

According to the illustrated preferred em- 
bodiment of the invention, the apparatus collects two 
frames for each segment in the automatic segmentation 
mode of operation. In other embodiments, however, 
since the segments are continuous, the apparatus can 
sample only one frame per segment and that frame ? 
becomes the end label of one label pair and the 
beginning label of the next sequential label pair m 
the source bin. 

The segments of the video material, once they 
are input to the apparatus and the IMAGES formed 
therefrom, are represented as PAIR'S of IMAGES. The 
controller 22 orders the PAIRS into a list as they are 
created during . the input process. This original list, 
corresponding to the source bin, contains, for each 
PAIR, the physical time code addresses (both the source 
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time code and the internally generated system time 
code) of its component IMAGES, the addresses which 
indicate the previous and next PAIRS within the storage 
list, and information regarding the edit transition to 
5 the next PAIR in the sequence. All of this data is 

required to completely describe a sequence of segments. 
This becomes important as the editing progresses and 
the initial ordering of the source material is changed. 

Referring to Figures 2 and 7, as noted above, 
10 controller 22 directs the input video source material 
through a routing circuitry 132 to the video tape 
recorders. In addition, the controller 22 directs the 
video to routing circuitry 130 for delivery to the 
video digitizer 110 over line 143. As noted above, the 
15 video digitizer operates at a high enough conversion 
rate to grab a succession of frames on-the-fly. 
Consequently, the controller 22 operates the system to 
digitize the first and, if necessary, the last frame of 
each segment and to provide that digital data for 
20 storage on disk unit 146. Additionally, controller 22 
provides the disk storage with the necessary locatxon . 
and sequencing data outlined above. 

Referring now to the input mode flow chart of 
Figure 10, the input of data is specified at 340. The 

25 operator then selects either automatic or manual shot 
(segment) selection at 342 and thereafter the source 
device, for example, a video tape recorder, is ini- 
tiated and the apparatus video tape recorders 14, 16, 
18, ... 20 begin recording at 344. Once source 

30 material begins to be received, at 346, the controller 

22 allocates storage for an empty "PAIR" at 348. The 

apparatus then grabs an "IMAGE" on-the-fly and stores 

the image at 350. The first IMAGE of a pair is stored 

. - r- ^ a second 



as the starting frame of the new PAIR at 352. 
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IMAGE is then obtained at 354 and this IMAGE is stored 
as the ending frame of the new PAIR at 356. The now 
formed new PAIR is added to the end of the prevxously 
stored PAIR'S in the source bin at 358. The 

5 illustrated sequence returns- to the decision at 346 and 
the next segment of source material is generated and 
processed. When there is no additional source 
material, the system proceeds to stop the recording 
video tape recorder(s) at 360 and then enters (or con- 

10 tinues in) the sort mode of operation at 362. 

The operation of obtaining and storing an 
IMAGE (at 350 or 354) requires, at 369, a signal indi- 
cating a manual or automatic designation of the 
segment. Each designation of a segment, for all but 
15 the first and last segments, causes two frames to be 
digitized, a first digitized frame, representing the 
ending IMAGE of a segment and a second digitized frame 
representing the beginning IMAGE of a next segment. 
The frame is digitized and stored temporarily in the 
20 digitizer at 370. An IMAGE is allocated to an empty 

image storage location at 37 2 and the actual storage of. 
the digitized frame, and its associated time codes, at 
that allocated location for the IMAGE occurs at 374. 
The IMAGE then is written onto hard disk at 376. 

25 The Sort Mode of Operation 

The sort mode of operation is the mode to 
which the system defaults. Referring to Figure 11A, 
the sort mode of operation is typically entered from 
the input mode by pressing the sort key 83. This is 
30 indicated at 550. In the sort mode, the controller 22 
monitors the control panel, at 552, to determine 
whether a key has been depressed, a lever has been 
changed, or a control wheel has been rotated. If any 
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of these events. occur, the controller 22 continues 
through a "checklist" to determine what has been acti- 
vated at the control panel and to take an appropriate 
action. If the status of the control panel has not 
changed, the controller 22 performs (at 554) the other 
ministerial bookeeping duties which occur. during the 
sort mode of operation (such as control of the VTR's) 
and returns again to check the status of the control 

panel. 

An important feature of the sort mode of 
operation is the capability of moving and controlling 
the location of the cursor whose location is designated 
by the cursor position indicating LED' s 324. As noted 
above, the position of the cursor is controlled by the 
cursor position lever 100. During normal operation in 
the sort mode, referring to Figure 11A, the controller 
22 typically monitors the status of the control lever 
100. This is indicated at 556. If the control lever 
100 moves to a new position, the sort mode of operation 
enters a cursor movement control procedure (at 558) as 
detailed beginning at 670 of Figure 11B. If the cursor 
is at the extreme edge of the display screens (at 671), 
and the directed movement is to a position beyond that 
edge, as indicated at decision block 672, the apparatus 
does nothing and returns to its normal monitoring con- 
dition as indicated at 674. Otherwise, the apparatus 
moves the active cursors to the position indicated by 
lever 100. This is indicated at 676. Typically, the 
control apparatus operates quickly enough so that lever 
100 can move only one position for one cycle of the 
monitoring system. 

If, prior to a left cursor movement, the 
• cursors are pointing to the first pair in a particular 
bin, that first pair is "dragged" along with the cursor 
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when the cursor moves to the left. Thus, at 678, the 
apparatus determines if the cursor is at the first 
label pair of the bin during a left shift, and if so, 
the apparatus shifts the pair to the left as the cursor 

5 move to the left, thereby moving all of the label 
displays to the left one screen position at a time. 
This is indicated at 680. Similarly, if the current 
label pair is the last pair in the bin and if the cur- 
sor is being moved to the right, at 682, the apparatus 

10 again "drags" the label display with it as the cursor 
moves to the right. This is indicated at 684.. If 
neither of the conditions at 678 and 682 are satisfxed, 
the new label pair designated by the cursor becomes the 
"current pair", at 686, and the apparatus returns at 

15 688 to the normal monitoring mode. 

Another important operational function in the 
sort mode is movement of the label pairs to the left 
and right (scrolling) on the passive display screens. 
This monitoring step is indicated at 560 in Fig. HA. 

20 The right hand control wheel 74 controls the incremen- 
tal position of the contiguous sequence of pictorial 
label pairs displayed, under the control of controller 
22, on the passive display screens. Counterclockwise 
movement of the wheel 74 increments the picture label 

25 pairs to the left. As the label pairs increment to the 
left, in the illustrated embodiment, each spatial posi- 
tion, for example central screens 54 and 56, represents 
successive, subsequent pictorial labels. Clockwise 
movement of the wheel increments the picture label 

30 pairs to the right wherein each vertical screen pair 
will represent successive prior pictorial labels. One 
wheel detent represents one increment of movement for 
one pair of vertically related pictorial labels (the 
label pair) in the illustrated embodiment. 



OMPI 



BNSDOCID <WO 8402606A1_I_> 



WO84/02606 



PCT/US83/01955 



-67- 



Referring to Figure 11C, the controller 22, 
when in the sort mode of operation, checks the status 
of the control wheel 74 (at 560, Fig. 11A) in connec- 
tion with the scrolling operation of the label pairs 
5 across the passive display screens. If scrolling is 

indicated, the next step at 602 (Fig. HO is to deter- 
mine whether scrolling is to the left or to the right. 
Depending upon the outcome of this determination, the 
next or previous pair of the current label pair list 
10 for the bin becomes the current label pair and labels 
of the display are updated by shifting to the left or 
to the right by one position. This is indicated at 
604, 605 and 606, 607. Thereafter, the controller 22 
determines, at 608, if the apparatus is in a "split" 
15 cursor node, as described hereinafter, in which case 
the cursor indicating element that marks the beginning 
label is updated. The apparatus then returns to the 
monitoring procedure of Figure HA employed with the 
sort mode of operation. 

In the sort mode of operation, the active 
control panel keys (Figures 3 and 9) are the pull key . 
79, the discard key 80, the return key 81, che home key 
82, the insert key 84, the replicate key 85, the mark 
ke y 86, the black key 87, the collapse key 94 and the 
25 split key 98. These keys generally act upon the pic- . 
torial labels designated by the cursor and hence 
indirectly upon the segment or segments to which the 
designated labels relate. The physical positions, 
lengths, etc., of the segments on the video tape 
30 however do not change. In the sort mode of operation, 
the label pairs and at least symbolically the segments 
to which they relate, can be discarded, moved, marked, 
and otherwise manipulated into a sequence, designated 
by the operator, to properly represent a desired 
35 program sequence. 
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For example, assume that the cursor position 
designated by lever 100 points to the central passive 
display screens 54 and 56. Initially the label 
displayed on screen 54 will appear also on screen 34 
5 and the label displayed on screen 56 will appear on 
screen 36. The segment designated by that label pair 
will continuously loop on active main screen 32 if the 
apparatus is operating at a program bin level. If new 
video source material is being read into and stored on 
10 the VTR's with automatic sampling, the apparatus can 
still enter the sort mode of operation. Upon pressing 
the sort key, the operator has the capability of mani- 
pulating the label pairs already in the source bin as 
described, in detail hereinafter. The operator will not 
15 however be able to see a display of the segment on the 
active display screen 32 as is typical during the sort 
mode of operation. Thus, this procedure advantageously 
' allows sorting operation to proceed at the source bm 
level while input material is being recorded on the 
20 VTR's. (Clearly, the VTR's cannot simultaneously 
record input material and at the same time provide 
video for a continuous loop display on screen 32.) 

Further assume, however, that a segment is to 
be removed (pulled) from its present position in the 
25 sequence and inserted at another portion of the program 
• sequence. This pull and insert procedure can be 
effected as follows. Assume that the apparatus is 
operating at a program bin level, and it is desired to 
move the segment identified by the labels appearing on 
30 screens 62 and 64 to a position between the segments 
identified by the label pairs on screens 44, 4 8, and 
50, 52. There are a number of different procedures 
available to the operator/editor. One method for 
accomplishing this task is (a) to position the cursor, 
35 using lever 100, above and below screens 62 and 64, (b) 
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depress the pull key 79, thereby removing the label 
pair originally on screens 62, 64 into the select bin 
(later occurring label pairs move one increment to the 
left), (c) move the cursor to a position above and 

5 below screens 50 and 52, and (d) depress the insert key 
84. The originally pulled label pair is inserted into 
the sequence and appears on screens 50, 52. The label 
pairs appearing on screens 50, 52, 54 68 increment 

one spatial position to the right (the labels on 

10 screens 66, 68 thus disappear from view). 

• The effect of pressing the pull key is thus 
to remove the label pair on the screens selected by the 
. cursor from the then existing sequence and place it m 
the select bin. Depressing the pull key in the 
15 illustrated example, thus deletes the label pair origi- 
nally displayed on screens 62, 64, and moves the label 
pair originally on screens 66 and 68 to screens 62 and 
64, respectively. The next, later occurring sequential 
label pair, then appears on screens 66 and 68. 

20 Referring now to Figure 11D, the pull opera- 

tion outlined above begins at 660. The pull operation 
at 660 is entered in one of two ways, namely, by 
depressing either the pull key or the mark key. If it 
is the mark key 8 6 which initiates operation, a deci- 

25 sion, at 662, directs the controller 22 to save the 
marked location at 664 and return to the monitoring 
decision list at 552 of the sort mode of operation. 
If, however, the pull key initiated the pull operation, 
the apparatus proceeds to excise the current pair from 

30 the bin, at 666, and to store it in the select bin at 
668. (If the discard key had been pressed, the pair 
would have been inserted into the discard bin instead 
of the select bin.) Thereafter, the label display is 
uodated and the cursor indicating elements, if a group 
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operation had been performed, are' changed. This is 
indicated at 670. The apparatus then returns to the 



mon 



itor mode of operation 



• ~ inqprt kev (see Fig- HE) has 

Depressing tne insert ^ e Jf ^ 

, the effect of placing the most recently "pulled" label 
pair, presently available in the select bin, at the 
position indicated by the cursor and moving all suc- 
ceeding label pairs, including the one originally 
displayed at the position identified by the cursor, to 

L0 the right (later in time) one position. 

As an alternative procedure, instead of 
raoving the cursor from screens 62, 64 to screens 50, ,. 
52, the control wheel 74 could be employed, after the 
pull key has been depressed, to move a selected label 
15 pair to the location of the cursor. That is, rotating 
the control wheel 74 three detent positions m the 

,. . . v,_- t he effect of moving the labex 

clockwise direction, has tne eciet-u 

pair originally appearing on screens 50 and 52 to 
screens 62 and 64. Thereafter depressing the insert 
20 key inserts the previously "pulled" label pair at the 
required sequential position of the video sequence. 

The apparatus, by employing the mark and 
return keys 86 and 81 respectively, can automate 
somewhat the more laborious sequence noted above. 
25 Thus, in the example outlined, the cursor is positioned 
at screens 50 and 5 2 and the mark key 8 6 is depressed. 
The cursor is then moved and aligned with the labels 
originally on screens 62 and 6 4" and the pull key is 
depressed. The return key is now depressed and the 
30 cursor moves, under control of controller 22, back, to 
the originally marked labels, to passive screens 50, 
52, in the example. Thereafter, with the cursors ^ 
aligned with the labels at which the insertion is to be 
made, the insert key 84 is depressed. 
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As noted above, in the illustrated embodi- 
ment, the apparatus has a "select" bin which operates 
in a last in, first out (LIFO) mode. The select bin 
has an essentially unlimited capacity. (In fact the 
select bin capacity is limited by the memory capacity 
of the system.) Thus, the cursors can be aligned with 
a plurality of different label pairs, according to the 
illustrated embodiment, and the segments associated 
with the label pairs "pulled" in a selected sequence. 
The pull is made each time by depressing the pull key. 
The effect of repeatedly pressing the pull key (without 
-inserting") is to successively store, in the select 
bin, a desired sequence of label pairs for later 
recall. 



15 



20 



After the selected shots have been thus 
"pulled" and stored, the cursor is aligned at the posi- 
tion wherein the insert is to be made and the insert 
key is depressed, for example a number of times equal 
to the number of "pulls" which have been collected. 
Each depression of the insert key inserts, at^the posi- 
tion designated by the cursor, the next "last- 
collected label pair still in the select.bin. Thus, if 
eight segments had been collected by depressing the 
pull key eight times at, for example, different posi- 
25 tions in the video sequence, the eight collected 
segments can be inserted into the sequence at any 
selected position(s) by thereafter depressing the 
insert key eight times. Because the select bin acts 
like a LIFO buffer, the effect is to recall and insert 
the segments so that they appear, at the end of the 
insert operation (and assuming that the cursor is not 
moved), in the same sequential order in which they were 
pulled. This multiple pull collection system can be 
employed in combination with the mark and return keys 
noted above, and further can be used in connection with 
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a home key 02 to insert all of the pulled segments at 
the. beginning of the video sequence for a program bin. 
Depressing the home key, after the label pair(s) has 
(have) been pulled, automatically aligns the cursor 
with the label pair representing the first segment of 
the program bin sequence. The sequence of operation is 
thus -pull-, "home", and "insert". Note that the mark 
key is not needed. 

Thus far, it has been implicity assumed that 
the pull and insert operation occurs solely within one 
bin and that the various bins function in an equivalent 
manner. It is appropriate at this point, to discuss 
further the characteristics of the several classes of , 
bins and how the pull and insert procedure operates 
differently in the illustrated embodiment, depending 
upon the class of the bin. The pull and insert opera-, 
tion can be carried out, as described above, within any 
of the program bins. The operation however cannot be 
employed in the select bin which operates solely 
according to a last in, first out stacking procedure. 
In the select bin, the characteristic connected 
sequence of related label pairs, which is typical of 
the source bin and the program bins, is not present. 
The select bin, which can be likened to an infinite 
LIFO storage register, therefore does not permit the 
pull and insert operation. 

Furthermore, the pull and insert operation 
cannot be employed solely within either the source bin 
or the discard bin. However, material in either the 
source bin, the discard bin, or any of the program bins 
can be "pulled" from the bin, that is, removed from its 
sequence in the bin, and moved to any program bin by 
"inserting". Thus, in its broadest concept, a label 
pair can be pulled from any program bin, or from the 
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source or discard bins, which results in the pulled 
label pair being stored in the select bin, and 
inserted, at any desired location in any program bin. 
The operator moves a "pulled" label pair to a different 
program bin by operation of lever 102. After placing 
the cursor at a specified location in the new program 
bin, for example by depressing the return key to auto- 
matically move the cursor to a previously marked loca- 
tion, the insert key is then depressed, and the 
"last-in" label pair inserted into the select bin is 
thereby removed from the select bin and inserted at the 
location marked by the cursor. 

Referring to Figures 11A and 11E, when the 
insert key is depressed, controller 22 begins an 
"insert operation" at 640. The controller, as noted 
above, retrieves the last added pair (or pair group) 
from the select bin at 642 and inserts - that pair (or 
pairs) in front of the current pair, that is, sequen- 
tially ahead of the label pair at which the apparatus 
is presently positioned as indicated by the cursor. 
This is indicated at 644. Thereafter, the label 
displays are updated at 646 and the just inserted label 
pair is made the current pair for the labels. Thus, 
placing a label pair in front of a currentypair has the 
effect of making the current pair occur later in time 
than the inserted label pair. 

The illustrated source and discard bins do 
not allow the pull and insert operation to occur solely 
within the one bin, and the apparatus "defaults" to a 
different mode of operation for these bin levels of 
operation. Considering first the source bin, according 
to the illustrated embodiment of the invention-,- the 
source bin stores label pairs corresponding to the 
source video material which has been divided either by 
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machine or by operator into a sequence of segments. 
Since, in accordance with this embodiment, it xs not 
permissible to pull and insert within the source bin, 
the operator has two bin related options. The first 
5 option allows the operator to designate, through the 
keyboard 104, a program bin into which pulled label 
pairs from the source bin are to be inserted. In 
accordance with this aspect of the apparatus, there xs 
no need to -pull" and "insert"; rather, the label paxrs 
10 are automatically transferred from the source bin xnto 
a designated program bin location when the "insert" key 
is actuated. In particular, the segments will be 
inserted in the specified program bin at a specifically 
marked position, previously designated by the editor. 
15 Alternately, as a second option, if no program bin xs - 
designated, the apparatus defaults to a predetermined 
program bin into which pulled source bin label paxrs 
are automatically placed at the "home" position. 

The discard bin operates in a mannner 
20 substantially identical to the source bin. The pull 
and insert procedure cannot -be followed within the 
discard bin itself; and therefore, the apparatus either 
inserts "pulled" label pairs from the discard bin at a 
marked location in a specified program bin, or the 
25 label pairs are placed at a machine-determined default 
option location in a system specified one of the 
program bins. 

The sort mode has a further powerful grouping . 
capability which allows several segments to be treated 
30 as one segment. For example, several segments can be 
- grouped or collapsed into a single segment in a single 
operation. This operation, "segment grouping", is 
effected by depressing collapse key 94 and the left 
accept key 99 for fixing the top cursor, thereafter 
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moving the bottom cursor to the right (note that this 
is the only direction in which the bottom cursor can be 
moved) using cursor position lever 100. After the bot- 
ton cursor is fixed at the desired position, the right 

5 accept key 88 is depressed. The result is to collapse 
into one label pair a plurality of sequential label 
pairs, that is, to describe a plurality of segments 
together as a single segment. The top cursor iden- 
tifies the top (beginning) label of the new label pair 

10 and the bottom cursor identifies the bottom (ending) 
label of the new label pair. Thereafter, the group of 
segments is treated as a single segment and is repre- 
sented by a single label pair. 

In the illustrated embodiment, segment 

15 grouping can only be accomplished if the segments to be 
collapsed occur sequentially (i.e.,. are contiguous) in 
the original source material. This limitation, which 
is in part a direct result of the method used for 
describing a segment, that is, using a pointer from the 

20 present segment to both the previous segment and the 

next segment, limits the power of the operation in this 
implementation. In other embodiments of the invention 
wherein a more complex and hence time consuming data 
organization can be tolerated and employed, this limi- 

25 tation can be avoided: one example is to use internal 
computer bookkeeping to maintain a list of pointers for 
segments within a segment. It is also important to 
recall, that since the illustrated embodiment uses 
serial storage media, it is significantly more dif- 

30 ficult to implement, in real time, an arbitrary 

grouping of segments. If a random access storage media 
were available, the ability to recall segments in real 
time, and in a substantially arbitrary order, is much 
greater and is simpler to implement. 
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The concept of segment grouping can be 
further described in connection with the OP«.tl« of 
controller 22, with -reference to the flow ^ f 
Figure 11F. Segment grouping can be achieved, as noted 
, above, by first pressing the collapse Key 94 ^ ^ 
accept Key 99. When this occurs, the W« to « 
the collapse portion of its operation at 620 and first 

■ K-i-h.r-' the accept key has been previously 
determines whether the acceyu x 

depressed (in which case the starting label pair for 
[0 the new grouping, would have been previously -*•*>• 
«hen the accept key has not been previously pressed by 
the editor, referring to the decision block 622, th. _ 
current label pair is denoted as the beginning pair of 
a new group, (at 624), and the apparatus 

mode of operation. When the collapse 
15 normal monitoring moae oi 

• .„t-»,-»d after the right accept key 88 
function 620 is entered >■ _ 

, ls . noted above, after the 

has been depressed, that is, as no 

bottom cursor has been moved to identify the ending 
label pair of the newly defined segment, the controller 
20 22 follows the decision path to the operations indi- 
cated at 624. Thus, the first label of the first pair 
of the group is designated as the starting label for a. 
new collapsed segment, and the end ng la* n ot ^the 

„ ■ i= changed to the ending label for the 

first segment is cnangea a +- 

25 last label pair of the collapsed group 

626, all other pairs in the group, that is 
except the current pair, are deleted. The label 
display and the displayed segment loop are then 
updated, at 628; and the controller returns to 

30 ma l monitoring mode of operation. 

More generally, the grouping capability can 
be extended to all operations. The grouping function 
is initiated by pressing accept key 99 and the desired 
function key simultaneously. This defines the ^ 

• • i»h«o. oair of the group. The bottom cursor 
35 beginning label pair oi «-"<= ^ 
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then blinks and, as noted above, can be moved by the 
cursor lever 100 while the top cursor stays positioned 
above the selected beginning label pair so long as that 
beginning label pair remains on the passive display 

5 screens. Using the control wheels, the selected 

beginning of the new segment can be scrolled off the 
display screens, in which case a top cursor indicator 
is no longer lit. Thereafter, the accept key 88, in 
conjunction with a function key, defines the entire 

10 operation to be performed on a group of segments. For 
example, the accept keys can be employed in conjunction 
with the mark key to define a display loop which inclu- 
des all or part of a program bin. 

Once the desired program sequence, or a por- 
tion thereof, has been edited, the sort mode has a 
further powerful capability for reviewing a part or all 
' of the edited program, quickly and prior to the time 
consuming practice of on-line conformation. Thus if, 
for example, a program must be further shortened or 
20 lengthened, appropriate sequences for reediting can be 
identified quickly within the context of the 
surrounding program material. The identified segments 
can then be reedited using the trim or splice modes 
without requiring the second confirmation as is the 
25 current practice. 

This review operation is effected by first 
placing the cursor at the label pair associated with 
the first segment in the sequence to be viewed, and 
then fixing it in position by pressing the accept key 
3 0 99 together with the sort key 83. The bottom cursor 
component originally associated with the ending label 
of the first label pair is then moved from a position 
juxtaposed to the ending label of the label pair asso- 
• ciated with the ending segment. The control wheel 74 
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and/or the cursor positioning lever 100 operate to move 
the cursor bottom component and the cursor is f xxed xn 
position at the indicating element associated wxth the 
ending label of the ending segment label parr by 
pressing the accept key 88 together with the sort key 
83. The program material referenced by all label paxrs 
located between the two cursors will now be displayed 
on the main monitor screen 32 in a continuous loopxng 
fashion until interrupted by pressing the sort key 83. 

In accordance with this aspect of the sort 
mode, the controller 22 determines a sequence in which 
the VTR's are to present the continuous loop dxsplay of 
the segments identified as described above- The 
controller thereafter issues the necessary commands to 
the VTR interfaces describing the time at which a VTR 
is to operate, the position on video tape at whxch _ 
operation is to begin, and the duration for whxch 
operation is to take place. In this manner, the 
controller 22 creates what is in effect a time 
sequenced list of commands which determine how the 
grouped segments will be displayed on screen 32. 

The apparatus has further sort mode capabili- 
ties for enabling easy and convenient editing of the 
source material. Thus, the split key 98 causes a ■. 
segment represented by an identified single label paxr, 
the 4 label pair being the one denoted by the cursors, to 
be split into halves, or quarters, etc., by pressxng 
the split key one or more times. 

The sort mode employs the replicate key 85 to 
reproduce a label pair, and in effect the corresponding 
segments, without removing the original label pair from 
its current location in for example a program bxn. 
Thus, depressing the replicate key causes the 
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troller 22 to reproduce the selected label pair PAIR 
in the select bin without altering the present location 
and- position o£ the label pair PAIR in the bin in which 
it is presently positioned. 

The discard key, operating in the sort mode, 
moves a label pair (and hence effectively the segment 
to which it refers) from a present location to a 
designated position in the discard bin. 

The apparatus further has the capability of 
inserting black video, of a predetermined length, at a 
selected position in the video sequence of any program 
bin. The black video is inserted at the position indi- 
cated by the cursor, positioned by lever 100. 
Depressing black video key 87 implements this opera- 
15 tion. In the illustrated embodiment, a preselected 

black segment having a length of one second is inserted 
at the position indicated by the cursor. Longer 
segments of black can ' be built up by repeatedly 
depressing key 87. Optionally, black segments of any 
desired length can be defined using the keyboard 104 
and monitor 105. The black segments are treated like 
any other segment in the system and can be reduced in 
time length by operation in the trim mode. 
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The Trim Morig of Operation 



With reference to Figures 2 and 3, in the 
trim mode, entered by pressing the "trim" key 78, the 
length of a segment can be shortened or lengthened. 
The cursor position identifies the segment to be 
trimmed; and, as noted above, the beginning label of 
the segment appears on screen 34 and the ending label 
appears on screen 36. The display of the segment loops 
on the main screen 32. The trim mode, in this 
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illustrated embodiment, can be used in connection with 
any program bin and with the select bin. 

The left control wheel 76 controls the pic- 
torial display on the intake screen 34, and the right 
hand control wheel 74 controls the pictorial display on 
the outtake screen 36. The pictorial labels used 
herein are, as noted above, the first and last frames 
of a segment. Thus, when the control wheels change the 
duration (either shorter or longer) of a displayed 
segment, either at the beginning or end of the segment 
(or both), the pictorial labels associated with the 
newly defined segment automatically appear on screens 
34 and 36. The original label pair, shown on the 
passive display screen, does not change. For each 
wheel 74, 76, counterclockwise rotation causes con- 
tiguous frames prior to the then displayed label to 
appear as a -temporary" pictorial label on the screens 
34, 36, respectively, while clockwise rotation causes 
contiguous frames subsequent to the then displayed 
label to appear as a "temporary" pictorial label. Each 
wheel detent, as noted above, corresponds to one video, 
frame. The central display 32 provides a continuous 
loop display of all the frames from the "temporary- 
intake label on screen 34 to the "temporary" outtake 
pictorial label on screen 36. When the accept keys 88 
■ and 99 are simultaneously depressed, the respective 

"temporary" pictorial labels are made permanent and £he 
new segment definition is fixed. When the beginning 
and ending of the segment has been so accepted, the new 
30 labels describing the segment automatically replace, xn 
the spatial array of passive display screens, the ori- 
ginal labels previously associated with the segment. 
These "fixed" labels can be trimmed again if needed. 

In the trim mode, when a particularly long 
35 segment is being shortened, it is generally desirable 
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to employ a first rough approximation to the shortened 
segment prior to precisely trimming it. There is pro- 
vided, therefore, as the segment is being displayed in 
the trim mode on the main active screen, the capability 
of marking the beginning and the end of the segment 
"on-the-f ly" • The proposed new beginning or intake of 
the segment can be flagged by depressing mark key 86 
together with accept key 88. Similarly, the proposed 
new end or outtake of the segment can be flagged by 
depressing the mark key 8 6 together with the other 
accept key 99. This rough cut procedure automatically 
designates the marked frames as the temporary labels 
appearing on screens 34 and 36 and allows a precise 
trim to thereafter, and more easily, take place. 

The trim mode of operation described above is 
called the "video-style" of trimming. In addition, 
there is a second style of trimming, termed 
"film-style". To enter the film-style of trimming, the 
operator presses the trim key 78 a second time. The 
trim key can be pressed repeatedly to switch back and 
forth between the two styles of presentation. 

According to the film-style of trimming, the 
controller 22 modifies the display presented on the 
passive display screens and replaces the label pairs 
adjacent to the label pair of the segment being trimmed 
with the frames adjacent the beginning and ending 
labels. That is, the upper row of passive display 
screens displays the beginning label (at the cursor 
position) and the frames immediately preceding and 
immediately succeeding the beginning label to the left 
and right of the label, respectively. Similarly, the 
bottom row of passive display screens displays the ^ 
ending label of the segment to be trimmed and the fra- 
mes immediately preceding and succeeding that ending 
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label. The rotation of control wheels 74 ana 76 then 

varies the upper and lower presentations "^"^ 
by sliding the respective presentation to the rxght or 
left hence moving temporary labels into the selected 
cursor position. These temporary labels can be made 
permanent as described above by pressing both accept 

keys 8 8 and 99. 

• ~ m Fiaure 12, when the trim key 

Referring now to tigute x^r 

78 is pressed/ the apparatus enters the trim mode at 
800 and controller 22 first moves the various 7^° 
tape recorders to the initial . location, for dxg^x«»g 
frames centered around the beginning and ending labels 
of the PAIR denoting the displayed segment. This xs 
performed at 802. Typically, the controller 22 posi- 
tions the video tape recorders at positions approxima- 
tely sixty frames ahead of the beginning and ending _ 

• ... on urates the VTR's to digitize and 
labels, and then operates tne . .. a 

store a "window" of approximately sixty frames before 
and after the beginning and ending labels. This xs 
indicated at 804. Thereafter, if the apparatus is^in 
the film-style display mode, a set, comprising fourteen 
of the collected digitized frames centered around the 
beginning and ending labels, is displayed on the 
passive display screens as outlined above. This is 
5 indicated at 806. On the other hand, if a video-style 
trim is to take place, the collected frames are 
displayed on the active monitors as described pre 
viously. The operator can then adjust the beginning 
. and ending labels, as indicated at 808, while the 

controller responds thereto and continues to loop the 
segment defined by the cursor on the main display 
screen. If the current temporary labels are accep- 
table, they are stored as new images in the PAIR that 
was being trimmed. This is indicated at 810. If, 
however, the current temporary label is not acceptable 
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that is, the accept keys have not been pressed, the 
controller 22 loops back to redo, if required, those 
temporary labels. This decision point is indicated at 
812. Once the new labels are accepted, the apparatus 
automatically returns to the sort mode of operation at 



814. 



In the film-style presentation, the apparatus 
advantageously highlights the labels as follows. In 
the upper row of labels, those labels which represent 
frames to the left of the cursor indicated position are 
dimmed while those labels, including the label at the 
cursor indicated position, which represent frames 
after, in time, the currently displayed beginning 
label, have a brightened display. Thus, the 
brightened labels represent the beginning of the 
segment, starting with the beginning label frame and 
including those later frames available for selection as 
the beginning label. Similarly, the dimmed labels of 
the upper passive display row represent frames which 
occur prior to the present beginning label. 
Correspondingly, in the lower row of passive display 
screens, the labels representing frames prior to and 
including the present ending label are brightened and 
the screens representing frames which occur after, in 
25 time, the present ending label are dimmed. As a 
result, the pictorial display shows in brightened 
labels those frames which form the beginning and ending 
portions of the looping segment, and shows in dimmed 
labels, those frames which are outside of the looping 
3 0 segment. 
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The Splice Mode of Operation 

In the splice mode, entered by depressing the 
transition key 89, controller 22 displays two segments 
of video in connected sequence. The segments 
selected under cursor control, and the cursor position 
is selected prior to entering the splice mode. Upon 
entering the splice mode, the cursor automatically 
splits, the upper cursor component moving one spatial 
position (or screen) to the right of the bottom cursor 
component. The two segments associated with the 
respective "label pairs are played in time sequence on 
the main screen 32 to display the splice. 

The splice display presentation on the main^ 
screen requires at least two video tape recorders, one 
recorder for the "from" segment and the other recorder 

„ Thus it is transition between 

for the n to segment • thus it. j-» 

two contiguous label pairs which is being edited. 
Screen 32 displays the transition sequence in a con- 
tinuous loop presentation from the video recordings 
available from the VTR's. Screens 40 and 34 display . 
the transition label pair, made up from the end label _ 
of the label pair of the first transition segment, thxs 
end label being the first label of the transition label 
pair, and the beginning label of the label pair asso- 
i ciated with the second transition segment, this 

beginning label being the second label of the tran- 
sit ion label pair. 

Screen 32 displays the output of the first 
VTR before the transition followed by the output of the 
0 second VTR after transition. Further, in the 

illustrated splice mode, as in the trim and sort modes, 
a loop interruption delay, for a "psychological break , 
is advantageous and controller 22 provides the delay 
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before the first segment of the transition is rerun, 
that is, before each repeat display of the two 
segments* 

Some transitions, such as an overlapping 
fade-out fade-in transition or a wipe, will require an 
overlap of two successive segments. During the overlap 
time, the video effects switcher 136 employs portions 
of the outputs of both the first segment VTR and the 
second segment VTR to generate the display for screen 
32. The default option, in this case, according to the 
illustrated embodiment, assigns as the first label of 
the transition label pair that frame of the first 
segment at which the "from" segment ends, and the 
second label of the transition label pair is that frame 
15 of the second segment at which the "to" segment begins. 
The transition label pair thus defines the transition 
point. The control wheels 74, 76 control the shifting 
and marking of the transition labels in the splice mode 
in a manner corresponding to the trim mode. The accep- 
tance of the new transition labels is indicated by 
simultaneously pressing the two accept keys. 



The initial beginning and end of the tran- 
sition is automatically preset by the apparatus when 
the operator/editor depresses one of the transition 

25 selection keys 90, 91, or 92. For example, when the 
dissolve key is pressed, the length of the dissolve is 
determined by the transition speed lever 101 and can 
vary between for example 15 and 105 frames, in fifteen 
frame increments. Preferably, the range of variation 

30 can be changed at the keyboard terminal. Further, the 
default option of the dissolve transition is timed to 
begin at the first label of the transition label pair 
and to proceed for its set length. However, an opera- 
tor can alter this default option using the keyboard so 
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either ends at the ending tran- 
that the transition eitner enua 

-4. u^fi, fi r>lit eoually between 
sition label or has its length split equa y 

the- beginning and ending transition labels and about 
the transition point. 

5 Similarly, the wipe key causes the transition 

to be one of seven presented "wipes" . The wipes are 
selected by repeatedly pressing the wipe key while the 
transition speed lever 101 is at the center position. 
The seven wipes can be selected from among the 
available SMPTE standards 0-24 through the keyboard. 

i <= cot bv the transition 
The length of the transition is set by tne 

speed lever. The length can be, for example, 30, 20, 
or 10 frames left to right, or 10, 20, or 30 frames m 
the reverse direction. The keyboard can be employed 
for determining the transition length. 

The soft cut key 92 selects a short dissolve 
and performs like the dissolve key except that the 
default speeds are significantly less, for example 2, 
4, 6,... 14 frames. Similarly, the cut key causes the 
transition to be a cut which can be considered an 
extreme of a dissolve wherein the dissolve has zero 

length • 

Lever 101 thus provides the operator with the 
flexibility of controlling transition speed, even 
25 during transition. 

in summary, during the illustrated splice 
m ode of operation, controller 22 operates the routing 
circuitry 134 (Figs. 2 and 6) so that displays 40 and 
34 show the freeze frame pictorial labels representing 
30 the temporary transition label pair currently *-lng 

viewed. The freeze frame video is available to routing 
circuitry 134 from either a VTR operating in the freeze 
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frame mode or, preferably, from the stored digitized 
pictures in cache memory. Further, displays 38 and 36 
canS if desired, display the output of the "first" and 
"second" video tape recorders respectively both before 
and after the transition point. The outputs displayed 
on screens 36 and 38 therefore show the "from" segment 
after the transition point and the "to" segment before 
the transition point. 

As noted above, controller 22 provides, in 
response to the keys 90, 91, 92, special transition 
effects between two segments. The transition between 
two segments in accordance with the fade-in fade-out, 
wipe, dissolve, etc. procedures, correspond to those 
standardly used on commercial television, and 
15 controller 22 provides these effects using the video 
effects switcher 136. In this manner, special tran- 
sition effects can be inserted into the program 
material by the operator through the console 12. 

Referring to Fig. 13, the controller 22, 
during the splice mode of operation, first queues the 
video tape recorders for collecting frames images for 
digitization, storage, and possible later display. 
Thus, the video tape recorders are initialized at 850 
to a location in advance of the transition point, for 
25 example, about sixty frames in advance thereof, for 
each segment. Thereafter, the frames adjacent the 
transition point for both the "to" and "from" segments 
are digitized, at 852, so that the apparatus has in 
storage the digitized frames which can form a new tran 
sition point. Thereafter, controller 22 scans the spe- 
cial effects transition keys 90-92, as indicated at 
8 54. If one of the keys has been pressed, that 
selected transition is processed by the controller 22 
using the special effects switcher 136. This is mdx- 
35 cated at 856. -^EX^ 
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The controller 22 next presents the frames 
for display either in the film-style display on the 
passive display screens or in the video-style display 
on the active display screens, and in either case, con- 
5 currently loops the transition on the main display 
screen. This is indicated at 858. (As described xn 
connection with the trim mode of operation, repetitive 
pressing of the splice key causes the controller 22 to 
switch between the video-style presentation and the 
10 film-style presentation.) The transition point can be 
changed, at any time, by using the control wheels 74, 
76 to designate a temporary transition label pair, and 
hence a temporary transition point. When a temporary 
new transition point has been accepted, at 860, by 
15 pressing the two accept keys, the temporary transition 
labels are made permanent, at 862, and the labels are 
stored and the transition PAIR is updated. The 
controller then returns to the sort mode of operation 
at 8 64. If the temporarily selected labels are not 
20 accepted, the controller 22 continues to loop the 
system until an acceptable transition sequence is 
adapted (or the splice mode is otherwise exited). 

. e»4-, i t>>e editor can leave 

Thus, while not shown m Fig. 13, the ecmor 

the splice mode of operation by pressing the trim or 
25 sort keys, leaving whatever permanent selections have 
been made intact, and otherwise defaulting to the con- 
ditions under which the splice mode was entered. 

In the splice mode of operation, when the 
film-style presentation is employed, the passive 

30 display screens have different brightnesses to better 
illustrate the present transition. In particular, m 
the upper row of screens, the pictured frames to the 
left of the cursor-indicated frame are dim while the 
cursor-indicated frame and those frames to its right 

35 are bright. Thus, the bright frames indicate those 
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frames which form part of the transition and which 
occur at and after the transition point. The dim fra- 
mes represent those frames occurring prior to the tran- 
sition point. Correspondingly, in the lower row of 

5 screens, those frames occurring to the left of and 
including the cursorindicated transition label are 
bright, while those frames occurring to the right of 
the cursor-indicated label are dim. Thus, the screens 
which are bright represent the flow or sequence of fra- 

10 mes into and through the transition point. 

System Operation 

In typical operation of the illustrated embo- 
diment, the apparatus repeatedly displays a single 
15 segment in the sort mode as follows. Two video tape 
recorders, which contain identical copies of the 
. segment, are each initially positioned at a location in. 
advance of the segment. Referring to Fig. 6, data, 
provided by the controller 22 to each video tape 
20 recorder associated interface, designates both a start 
time and a start position, as well as an ending posi- 
tion, for each recorder. At the earlier start time, 
which is referenced to the system clock generator 140, 
one of the video tape recorders begins to provide video 
25 signals to the routing circuitry 134 and hence to the 
video effects switcher 136. Controller 22 directs the 
• selected video to the main display 32. At a time prior 
to the end of the segment being displayed, the second 
video tape recorder begins operation in accordance with 
30 timing and position instructions previously received 
from the controller 22. At the end of the segment 
display provided by the first tape recorder, the video 
effects switcher changes the source of the signal con- 
nected to screen 32 from the first tape recorder to the 
35 second tape recorder, (both signals being available to 
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it over lines 204, 206), the timing being such that the 
second tape recorder, already up to speed, just begins 
the segment to be displayed at the transfer time. ■ 
Video' effects switcher 136 thus switches from the first 
5 tape recorder, over for example line 204, to display 
the beginning of the segment coming from the second 
tape recorder over for example line 206. (The timing is 
changed if a "psychological delay" is inserted between 
successive segments. In that instance, controller 22 
10 varies the timing to the second tape recorder so that 
it begins to play just after the delay time. A third 
VTR can be employed by controller 22, and its output 
selected, during the delay time.) Alternately, the 
presence of a -psychological delay" between the display 
15 of successive repeating segments can eliminate the need, 
for the second tape recorder so that a single tape 
recorder can be rewound and restarted prior to the end 

, -, • -.1 time. In that instance, the. 

of the psychological delay time. 

apparatus can employ one VTR. Note however, if the 
20 segment being displayed is relatively lengthy, the 
rewind time could exceed the allotted psychological 
delay time. In this instance, either two tape recor- 
ders would be employed or the psychological delay can 
' be lengthened to allow the VTR sufficient rewind time. 

25 As the second recorder operates and provides 

video to screen 32, the first tape recorder stops and 
rewinds to a position before the beginning of the 
segment so that at the end of the segment then being 
displayed from the second tape recorder, the first tape 

30 recorder will be ready to display the segment again. 
This sequence of operations can provide a continuous 
non-interrupted loop (or as noted above, an interrupted 
loop) repeating the selected video segment. 

In addition to the display on screen 32, 
35 screens 34 and 36 receive, through routing circuitry 
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134, the pictorial labels associated with the then 
current segment. These labels are provided under the 
control of the controller 22, either from other video 
tape recorders operating in a freeze frame mode, from 
the display processing unit 112 over lines 202, or from 
storage such as the cache memory. 

The Control Panel 

The composing apparatus, whether it operates 
in the sort, trim, or splice modes requires substantial 
hand and eye interaction. In particular, the 
operator/editor must inevitably watch not the hand 
controls but the various video screens in front of him 
to make the necessarily precise decisions with respect 
to sorting the source material, moving it from bin to 
15 bin, trimming it, and effecting transitions from 

segment to segment. The control panel thus has a con- 
figuration to provide significant tactile feedback to 
the operator so that, without looking at the manual 
controls, the operator has a full understanding, gained 
through use, of where the various, keys and levers are 
located. 



Referring now to Figure 9, which is an 
enlarged view of the control wheel 74 and its asso- 
ciated keys and levers, the key structural con- 
25 figuration has plural structural ^configurations for 
providing positive tactile feedback which enables the 
operator to select the proper keys without actually 
looking at them. An upper 400 and a lower 402 exterior 
region provide respectively automatic positioning for 
the fingers with regard to keys 78, 79, and 84 (upper 
region 400) and keys 87, 82, and 83 (lower region 402). 
Furthermore, the middle keys, keys 79, 80, 81, and 8 2 
have a structure wherein two keys have a longer lateral 
reach (keys 79 and 82)- and two keys have a shorter 
35 lateral reach (keys 80 and 81). These keys, having 
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different lateral reaches, define interior upper 404 
and lower 406 regions of tactile stimulation which pro- 
vide positive positioning feedback with respect to the 
interior keys in the row, adjacent wheel 74. The 
remaining keys, keys 85 and 86, are automatically ^ 
referenced with respect to the known keys surrounding 
them. As a result, all of the elements of the hand 
operated composition control panel are locatable 
without visual confirmation. 

Note also that keys 78 and 83 have a shorter 
lateral extent than keys 79 and 82 or keys 80 and 81 to 
provide a yet further positive tactile stimulation 
feedback regions 408 and 410. In addition, the short 
lateral extent of keys 80 and 81 enables a space to be 
developed between control wheel 74 and keys 80 and 81 
to provide a further internal feedback region 412. 

Another non-visual feedback parameter, as 
noted above, is the number of detent positions spe- 
cified for a full 360" rotation of control wheel 74 (or 
76). A complete revolution, thirty detent positions, 
corresponds to one second of video in the trim and 
splice modes. This enables the operator to easily and 
accurately increase or decrease the length of a segment 
without looking at the control panel. The relatively 
> isolated location of the accept switches 88 and 99, and 
of the levers 100, 101, 102, and 103 described m 
detail above, enables an operator to find and use these 
manual elements without visual confirmation. Thus, the 
structural configuration of the manual controls permit, 
the operator to maintain visual contact with the video 
displayed on the screens while tactile feedback from 
the manual controls substantially eliminates the need 
for visual confirmation ♦ 
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In an alternate illustrated embodiment for 
controlling the flow of video (and audio) signals 
according to the invention, elements corresponding to 
elements of Figures 1-9 have been designated by the 
same reference numbers, and elements which have been 
modified, but still closely resemble functionally ele- 
ments of Figures 1-9, have been designated with a like 
reference number including a for example 24*. 

Referring to Figure 14 , a alternate flexible 
routing structure features a video/audio bus 500 
wherein each video signal and each audio signal is 
assigned to a distinct transmission path, here a 
transmission wire pair. Further, each element 
requiring a signal from or connecting to the bus 500 =' 
makes connection through a routing circuit 502a, 
502b,... 502s. Each routing circuit in this illustrated 
embodiment is identical to each other routing circuit ' 
except that each routing circuit has a different 
address and is hence addressable, directly or 
indirectly, from, for example, the controller 22. Each 
routing circuit operates to connect any line of the bus 
500 to an associated operating station under the direct 
or indirect control of controller 22 and to connect a 
line of an operating station to its assigned bus line. 

Referring now to the video tape recorders, 
each video tape recorder connects to a video tape 
recorder interface and to a routing circuit. The video 
tape recorder interface is similar to that interface 
described in connection with Figures 2 and 8 and is 
modified therefrom to accommodate the routing circuit, 
that is, to provide control for the associated routing 
circuit over the video (and audio) signals connected 
between the video tape recorder and the routing circuit 
(Figure 15) . 
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in a substantially similar manner, the video 
effects switch 136, the video input port 276, the video 
input port 275; the video output port 274, the video 
t.£ recorder 166, the video input port 270, the video 
5 digitizer 110, the display processing unit 112, and the 
video display screens 32, 34, 36, 38, *nd 40, each have 
associated therewith a routing circuit for making 
available to the particular operating station any of 
the video signals on bus 500 and making available to 
10 the assigned bus paths of bus 500, any video signals 
emanating from the operating station. In addition, 
there is illustrated in Figure 14, an audio effects 
switch 504. This switch allows the audio signal to^ 
follow the video signal. The switch can be obtained 
15 commercially and operates in response to and under - 
control of the controller 22 to modulate and switch 
audio signals available from bus 500. 

Normally, the audio which accompanies the 
recorded video material is copied and composed at the 

20 same time that the video material is copied and com- 
posed. If, however, it is desired to either overlay, 
substitute, or insert new audio into the composition 
product, this can be accomplished using the audio in an 
overlay relationship to a desired segment. This func 

25 tion is provided for by controller 22 using, for 
example, the audio effects switcher. 

In one other embodiment, for example, a pair 
of audio controlling foot pedals can control a video 
independent audio source during the composition P ro- 
30 cess. The audio foot pedals enable a shift in the 
audio location relative to the video during the com- 
positon process. One of the foot pedals provides -for- 
ward and backward slip of the video independent audio 
while the other pedal controls the rate of shift. 
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Thereby the video independent audio is synchronized 
with the video. 

Referring to Figure 15, a typical modified 
VTR interface circuit 24', corresponds substantially to 

5 the circuit of Figure 8 with the addition of a routing 
control circuit 510. Routing control circuit 510 con- 
nects to the control processor 300 and receives from 
processor 300 address and routing bus identification 
signals which are stored in circuitry 510 and are pro- 

10 vided to the routing circuit 502a. Circuitry 510 

comprises a plurality of latches which store data from 
control processor 300, the data including the specific 
address of the routing circuit 502a and the specific 
connections between the VTR inputs and the routing bus 

15 500. The processor 300 receives the instruction data 
from the controller 22. In this illustrated embodiment 
of the invention, the video cape recorder receives from 
the routing circuit a video input over a line 280', and 
audio inputs over lines 512 and 514. Similarly, the 

20 video tape recorder provides to the routing circuit, a 
video output over a line 282' and audio outputs over 
lines 516 and 518. In other respects, the operation 
and configuration of interface circuits 24 and 24' are 

the same. 

25 Referring now to Figure 16, each routing cir- 

cuit 50«2 has a video section 520 and an audio section 
522. In the video section, the video, for example from 
a VTR over line 282', connects directly to the assigned 
bus path of the video bus portion of the routing bus. 

30 The internal connection is illustrated by the dashed 

line 524. Similarly, the audio inputs from for example 
a VTR over lines 516 and 518, connect directly to 
assigned lines of the audio bus portion of the routing 
bus as indicated by dashed internal connection lines 
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526 and 528, respectively. More or fewer direct inter- 
nal connections can be employed. 

Each section of the routing circuit 502 
employs a cross-point switch array, 530 and 532, for 
connecting any audio or video line of the routing bus 
to the inputs of an operating station, such as a VTR 
video input. The cross-point switch arrays 530 and 532 
receive control signals from a VTR interface over lines 
534. Lines 534 reflect for example the outputs of the 
latch element of circuitry 510. - 
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Referring now to Figure 17, each cross-point 
circuit array 530, 532, receives the control signals 
over lines 534. The arrays 530, 532 function substan- 
tially identically, and only array 530 shall be 
1£ = described in detail. If the address on the control 

lines matches the address present in an address decode 
and latch circuitry 540, the circuitry 540 latches and 
stores the signals input over lines 534. Those signals 
designate the bus line which is to be connected to the 
20 output line(s) of the array, for example to line 542. . 
The output of the address decode and latch circuitry 
540, over lines 544, represents the instruction portion 
of the control data and acts to control an N:l decoding 
circuit 546. Decoding circuit 546 provides an enabling 
25 output over one of its "N™ output lines corresponding 
to the instruction input over lines 544. 

Each output line of the decoder 546 actuates 
one of a plurality. of switch elements 548 to a pass 
through state. Each switch element 548 is a gate 
30 controlled analog switch which in one state (the 

actuated state) passes the signal on its analog input 
line and in its other state blocks that signal. The 
outputs of the switches 548 have a common connection to 
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the output line 542 of the array. Thus, a selected one 
of the bus input lines can be provided to the output 
lints 542. The operation of circuitry 532 is substan- 
tially identical to that of circuitry 530 with the 
exception that two groups of switch elements 548 and 
two corresponding decoders 546 are provided, one for 
each channel of audio being provided to the video tape 
recorders. Correspondingly, the address decode and 
latch circuitry of circuitry 532 can have additional 
latch registers to store the data which designate the 
switch(es) of the switch arrays to be actuated. 

With respect to routing elements not con- 
nected to one of the VTR's 14, 16, 18 and 20, a single 
interface element 268' has therein sufficient output 
capability to address and control each of the remaining 
routing circuits. Thus, referring now to Figure 14, 
the interface 268' is similar to a modified VTR inter- 
face, such as interface 24«; however, its processor 300 
is capable of receiving address and instruction data 
relating to several routing circuits and of directing 
that data to routing control circuitry 510 to provide 
over lines 505 address and instruction data signals for 
controlling the routing circuits 502e-502s. The inter- 
face 268' thus corresponds to the interface of Figure 
15 except that the circuitry 510 connects no longer to 
a single cross-point routing switch array circuit but 
to a plurality of them. Similarly, as noted above, the 
control processor 300 receives data from the controller 
22 relating no longer to one routing circuit but to a 
30 plurality of routing circuits. The output of the cir- 
cuitry 510 has both address and data information. The 
address information addresses a particular routing cir- 
cuit 502e-502s; and the addressed routing circuit then 
latches within it, using the latches of elements 540, 
35 the data which designates the • connection between the 
bus 500 and the associated operating station. 
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As noted above, the routing bus 500 has both 
video and audio" channels therein. The video portion of 
the. channel, designated 500a, and the audio portion of 
the channel, designated 500b, together comprise a 

5 single multiwire channel, in the illustrated embodi- 
ment, preferably a two hundred line flat wire bus which 
connects to each of the routing circuits 502. Thus, xn 
accordance with this second illustrated embodiment of 
the routing system, each operating station can receive 

10 the video and audio available on any of the channels of 
the bus. 

The video composing method and apparatus 
described herein provide the user with great flexibi- 
lity in manipulating and editing the video source 
15 material. The assembled material can be collected from 
many sources, in any order, for assembly and editing 
to form a finished program. Furthermore, after 
assembling his story, the user can go back and further 
edit the shots and scenes as required. He can rese- 
20 quence scenes and shots, adjust their length, or the 
transitions therebetween, just as he had done during a 
previous composing session. This recomposition process 
can continue with as many iterations as required 
without any loss of flexibility until the assembled 
25 material is satisfactory. 

It. is also important to realize that even 
though one considers the editing process as the editing 
of the source material, the source material is typi- 
cally not disturbed after recording on the composing 
30 apparatus VTR's. Instead, it is the label pair repre- 
sentations, and not the segments, which are moved, 
changed, etc.; and it is the storage of the labels as 
PAIRS of IMAGES which further provides great flexibi- 
lity and power to the apparatus. 
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Since the composition process always has 
available unmodified copies of the source material as 
its- reference, rather than second or third generation 
partially composed material, the editor/operator can 
always reinsert shots or scenes previously deleted or 
add completely new shots from the original source 
material or, from direct video input ports by receiving 
signals from external devices such as video cameras or 
remote feeds. The editor can even compose multiple 
versions of the same story using a single set of source 
materials (and the plural program bins) and decide at a 
later time which one to use for final release. 



When the composition is. complete, the appara- 
tus and method will produce a complete program package 
15 for news and/or an edit confirmation list in machine 
readable form (for programs) that can be used by con- 
ventional computer controlled on-line editing systems." 
This implementation can be accomplished with remote 
autoconfirmation with little or no operator interven- 
tion. In the illustrated embodiment, the system will 
also drive 3/4, 1, and 2 inch tape transports directly, 
as external interfaces, through interface 124, under 
the control of controller 22, no provide full on-line 
editing capability. 



Additions, subtractions, deletions, and other 
modifications of the invention will be obvious to those 
practiced in the art and are within the scope of the 
following claims. 

What is claimed is: 
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1. composing apparatus for selecting 
segments from image source material stored in at least 
one storage medium and for denoting serially connected 
sequences of said segments said apparatus comprising 
_ a pictorial display means , 

an operator control means, and 
a composing control means responsive to 
said operator control means for controlling said 
storage media and said pictorial display means, said 
10 composing control means comprising 

means for denoting a start and an 
end of each of a plurality of segments of said source 
material, 

means for identifying each said 
segment by a pictorial image segment label, 

means for selectively displaying 
segments of said image source material on said pic- 
torial display means, 

means for assembling at least a 

plurality of said labels into a serially connected 
label sequence, 

operator responsive means for 
locating any said segment by displaying said pictorial 

labels in said label sequence, and 

said displaying means being further 

adapted for displaying the segment identified by a 

selected label. 
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2. The composing apparatus of claim 1 
wherein said composing control means further comprises 

means for grouping serially connected 
ones of said, connected segments into segment groups, 
said segments in said segment groups having the same 
connected serial relationship as in said connected 

image sequence, 
3 5 in which 
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said identifying means are further 
selectively operable for identifying each segment group 

by a pictorial group label/ 

said operator responsive locating 

means is further selectively operable for locating any 
said segment group by displaying said pictorial group 
labels in a group label sequence corresponding to said 
segment group sequence relationship, and 

means responsive to said operator control 
means for selectively operating upon said segments and 
said segment groups using said labels and label groups. 



3. The composing apparatus of claim 1 

further wherein said pictorial display 
means comprises a plurality of pictorial display 
15 screens arranged in an ordered array, and 

wherein said operator responsive locating 

means further comprises 

means for providing said display screens 

with electrical signals pictorially representing a 
20 selected limited number of said sequence of said 
labels; and 

operator responsive means for changing 
the displayed labels. 



4. The composing apparatus of claim 3 
25 further wherein said pictorial display means comprises 

a plurality of display generators, each 
generator being responsive to said composing control 
means for receiving electrical signals representing an 
image to be displayed and for repeatedly providing 
30 said received image to be displayed on said pictorial 
display screens. 
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5. The composing apparatus of claim 3 

further wherein 

said operator responsive changing means 

selectively sequences said labels on said plural 
display screens according to said label sequence for 
searching for a labeled segment of said image source. 
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6. The composing apparatus of claim 1 
wherein said identifying means includes means for 
labeling each segment by two pictorial images, a first 
label image corresponding to a beginning frame of said 
segment and a second label image corresponding to an 
ending frame of said segment. 



7.- The composing apparatus of. claim 1 
wherein said apparatus comprises at least a first and a 
15 second serial storage medium, each storing a represen- 
tation of said segment to be displayed, and 

wherein said selectively displaying means 

comprises 

means for selectively controlling image 
20 information retrieval from said first and second 

storage media for repetitively cycling said first and 
second storage media for alternate image information 
retrieval whereby a continuous loop presentation of 
said segment can be displayed. 



25 8. The composing apparatus of claim 7 

wherein said composing control means further comprises 

means for inserting an interruption 
display image on said display means between repetitions 
of said repeating segment. 
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9. The composing apparatus of claim 1 
wherein said apparatus comprises 

a first serial storage memory for storing 
a representation of a first segment to be displayed, 
5 a second serial storage memory for 

storing a representation of a second segment to be 
displayed, and 

wherein said composing control means 
further comprises means for selectively controlling 
10 image information retrieval from said first and second 
serial memories for repetitively and alternately 
displaying said first and second segments whereby a 
continuous loop alternating presentation of said first 
and second segments is displayed. 



3_5 io. The composing apparatus of claim 9 

wherein said composing control means further comprises 

operator responsive means for varying a 
transition between said first and second segments. 



11. The composing apparatus of claim 10 
20 wherein said composing control means further comprises 

means for generating a transition 
display segment for insertion between said first and 

second segments, and 

means for inserting said transition 

25. segment into the serially connected image sequence 
between said first and second segments. 
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12. The composing apparatus of claim 9 
wherein said denoting means further comprises 

means for dynamically changing the start 
and end of each of said first and second segments. 
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13. The composing apparatus of claim 1 

further comprising 

a plurality of video tape recorders each 

having a video output, 

a plurality of video tape recorder inter- 

faces, each said interface being associated with one of 
said recorders, 

each said interface being further con- 
nected to said composing control means, 

whereby said composing control means 
operates and controls each said video tape recorder 
through its associated interface. 
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14. The composing apparatus of. claim 13 wherein 

display means further comprises 

a plurality of display screens, and 
video routing means responsive to said 
composing control means for connecting the video out- 
puts of selected ones of said recorders to selected 
ones of said display screens. 



20 



25 



30 



15. The composing apparatus of claim 14 

further comprising 

a video digitizing means having an 

analog-to-digital converter and a read/write digital 
storage memory, 

means for connecting said digitizing 
neans to said output video routing means and to said 

composing control means, and 

further wherein said pictorial display 

means comprises 

a plurality of display generators, each 
generator being responsive to said composing control 
means for receiving electrical signals representing an 
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image to be displayed and for repeatedly providing said 
received image to be displayed on said pictorial 

display screens, and 

said video digitizing means further 

5 having 

means responsive to said composing 
control means for converting a video input from said 
routing means into digital data and for storing said 

data in a digital memory f and 
10 means responsive to said composing 

means for making said data in said digital memory 
available to said display generators. 



16 . The composing apparatus of claim 14 

further comprising 
15 a plurality of video input lines, and 

input video routing means responsive 
to said composing control means for connecting selected 
ones of said video input lines to selected ones of said 
video tape recorders* 



20 17. The composing apparatus of claim 16 

further comprising 

a video clock generation means for 

generating clock signals including field address 
signals, and 

2 5 said composing control means further 



* * 



comprising 

means for selectively adding said 
address signals to video image data generated within 
said apparatus. 



30 18 



The composing apparatus of claim 13 



further comprising ^^tT^-EA £T 
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a video clock generation means for 
generating clock- signals including field address 

signals, and c ^ 

id composing control means further 



comprising 

means for selectively adding said 
address signals to video image data generated within 
said apparatus, and 

means for connecting said clock 
Is to each said recorder interface. 
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19 Apparatus for composing image source 
material stored on at least one image storage medium, , 
said source material being composed of a sequence of 
serially stored fields representing a time sequential 
visual image, sequences of said fields being associated- 
to form visual segments, said apparatus comprising ^ 

a pictorial display means for providing 
a pictorial representation of a selected current 

segment of interest, 

an operator control means, 

a composing control means operative with 

said medium and said operator control means and 

comprising 

means responsive to said operator 
control means for repetitively selecting successive 
current segments , . 

means for repetitively making 
available to said display means electrical signals pic- 
tor ially representing a then selected current segment, 

means for selecting from the then 

^ least one labeling field for iden- 
current segment, at least uhc 

tifying said segment, 

operator responsive means for 

defining said current segment to form a current defined 
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segment by denoting a new beginning and ending of said 
segment , 

means for maintaining a record of 
said sequences of defined segments in accordance with 
the label selecting and defining means, and 

means responsive to said operator 
control means for selectively providing electrical, 
signals to said display means for pictorially repre- 
senting at least a labeling field. 



10 



15 



20 



25 



3 0 



20. Apparatus for composing image source 
material stored on at least one image storage medium, 
said source material being composed of a sequence of 
staved fields representing a time sequential- visual 
image, sequences of said fields being associated to 
form a visual segment, said apparatus comprising 

an active pictorial display means for pro- 
viding a temporal pictorial presentation of a selected 
segment, designated the current segment, 

a plurality of passive pictorial display 
means, each for providing a visual presentation of a 
selected field of a sequence of fields forming a said 
visual segment, each said selected field thereby 
labeling one said visual segment, 

a plurality of storage memories, 
an operator control means, and 
a composing control means operative with 
said medium and said operator control means, said com- 
posing control means comprising 

means responsive to said operator 

control means for repeatedly selecting among said 
sequences of fields for editing said sequences, a last 
selected sequence being the segment designated the 

current segment, , 

means for repetitively providing 
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said active display with electrical signals from said 
at least one storage medium pictorially representing 
said current segment in a repeating display, 

means for selectively supplying each 
said passive display means with electrical data signals 
representing a selected one of a sequence of said 
labeling fields, 

means for associating with each said 

current segment at least one current label field, and 

means for maintaining a record of 

the sequence of current segments. 



21. The composing apparatus according to 
claim 20 wherein said control means further comprises 

means for manipulating said label fields 
15 representing said segments for forming a composed 
medium representation. 



20 



22. The composing apparatus according to 

claim 20 further comprising 

a system clock , 

a plurality of video tape recording 
means, each having a video output line and a video 
input line, 

a plurality of recording means interface 
units connected to said composing control means and 
25 each unit having 

means for operating an associated 
recorder in a forward mode and in a reverse mode, 

means for controlling the timing of 
forward and reverse operation of each said recording 
3 0 means, and 

said repetitively providing means 
further comprising 
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means for selectively and repetiti- 
vely-switching between said video output of at least 
two of said recording means for repetitively providing 
said current segment in a continuous loop format to 
5 said active display means. 



10 



23. The composing apparatus of claim 22 
wherein said repetitively providing means further 
comprises 

an operator responsive means for varying 
the segment playback rate of the current segment being 
displayed by said active pictorial display, and 

an operator responsive designation 

control for designating from a current segment a 
beginning field label and an ending field label. 



15 24. The composing apparatus of claim 20 

wherein said passive display means further comprises 

an ordered plurality of pictorial 
display means pairs, each pair having a first display 
screen. for providing a visual presentation of a 

20 beginning label and a second display screen for pro- 
viding a visual presentation of an ending label, each 
said pair of beginning and ending labels being asso- 
ciated with a segment of the sequence of current 
segments, and 

25 said repetitively providing means 

further comprising means for selecting a segment 
corresponding to a selected label for display by said 
active display means. 



25. The composing apparatus of claim 20 



30 further comprising 
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an operator console/ 

s-aid active display means being adapted 
to provide at least one display screen on said console, 

each said passive display means being 
5 adapted to provide a plurality of display screens on 
said console, said screens being positioned in an 

ordered spatial array, 

said selectively supplying means being 

further adapted to provide said passive display means 
10 with electrical signals representing a sequence of said 

pictorial labels, and 

said passive display means further 

comprising 

a display interface for receiving 
15 instructions from said composing control means and 
video data representing pictorial labels and for 
effecting an ordered pictorial presentation of said 

labels on said screens , 

whereby the spatial display on said 
20 screens provides in effect a temporal snapshot repre- 
sentation of a sequence of said segments. 



26. The composing apparatus of claim 25 

further comprising * 

means for mounting said screens in a two 

25 row ordered array, each column of screens being adapted 
to display a label pair associated with a defined 
.segment, and 

said composing control means further 

comprising 

3Q , means for dynamically searching 

through said labels by shifting said labels in the 

direction of an array row, 

whereby a search through said sequence 

of segments can be effected. 
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27. The composing apparatus of claim 20 

further comprising 

a system clock means, 
means for writing a clocked iden- 
5 tification tag to be associated with each said field, 
each identification tag for a field associated with one 
storage medium being uniquely identifiable from the 
identification tag associated with any other field 

associated with said one storage medium, 
10 a controlling interface associated with 

each said storage medium, said controller including 
means for receiving instructions from said composing 
control means and clock signals from said clock means, 

said instructions including at least a 
15 playback start time relative to said system clock 

means, a starting field identification, and a display 

time duration, and 

said interface means being further 

adapted for retrieving data from said storage medium in 
20 accordance with said instructions. 



25 



28. The composing apparatus of claim 27 
wherein each said storage medium is a video tape 
recorder, and 

further comprising 

means for recording on said recorder 

a video input signal, and 

- means for recording with said signal 

said clocked identification tags. 



30 

further comprises 



29. The composing apparatus of claim 20 
wherein said composing control means 



a central digital processor, 
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a digital bus connected to said pro- 
cessor/ and 

said passive display means further 

comprising * 

a plurality of display maintaining 

interface means being connected co passive display 

screens, and 5 

each display maintaining means 

comprising 

a display storage element for 
storing a digital representation of a label to be 
displayed, 

bus means for communicating 

with said digital bus, and 

display screen interface means 

for providing analog signals to said display screens for 

providing said visual presentation. 



10 



30. The composing apparatus of claim 29 

further comprising 
20 a plurality of media playback devices, 

each having a video output line, 

device interface means for controlling 

the data retrieving playback operation of said playback 
devices in response to said composing control means, 
25 routing means for selectively switching, 

under control of the composing control means, between 
said playback device video output lines for connecting 
a selected one video output line as the routing means 

output line, and 
30 an analog-to-digital converter connected 

to the routing means output line, and connected to the 
digital bus for providing a digital output video signal 

* 

thereto. 



y 
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31. The composing apparatus of claim 20 
wherein said composing control means further comprises 

means for automatically dividing said 
source material into segments according to a predeter- 

5 mined selection method, and 

operator controlled means for changing 

.said beginning and ending fields of said segments 
whereby the segment presentations displayed by said 
active display are dynamically updated to visually 
10 represent said new beginning and ending field. 



32. The composing apparatus of claim 20 

further comprising 

a printer connected to said composing 

control means , 
15 an alphanumeric input keyboard for 

inputting textual material associated with a labeled 
scene, to said composing control means, and 

said composing control means further 



20 



comprising 

means for printing a storyboard, 
said storyboard representing thereon a series of sce- 
nes, each represented by at least one pictorial label 
and the previously input textual material associated 
therewith. 



25 33. The composing apparatus of claim 20 

wherein said composing control means further comprises 

means for simultaneously controlling the 
playback operation of a plurality of video tape recor- 
ders for selectively providing the video signal data to 

30 the passive and active display means in response to 
instructions from an operator control panel. 
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34. A composing method for selecting 
segments from image source material stored in at least 
one storage medium and for denoting serially connected 
sequences of said segments, said method comprising the 
steps of: 

denoting a start and an end of each of a 
plurality of segments of said source material, 

identifying each said segment by a pic- 
torial image segment label, 

selectively displaying segments of said 

image source material on a pictorial display means, 

assembling at least a plurality of said 
segment labels into a serially connected label 

sequence, : 

locating any segment by displaying said 

pictorial labels in said label sequence, and 

displaying the segment identified by a 

selected label. 



35. The composing method of claim 34 wherein 
20 said composing control means further comprises the 
steps of 

grouping serially connected ones of said 
connected segments into segment groups, said segments 
in said segment groups having the same connected serial 
25 relationship as in said connected image sequence , 

identifying each segment group by a pic- 
torial group label, 

locating any said segment group by 

displaying said pictorial group labels in a group label 
30 sequence corresponding to said segment group sequence 

relationship, and 

selectively operating upon said segments 

and said segment groups using said label and label 



groups 
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36. The composing method of claim 34 further 

comprising the steps of 

. providing a plurality of pictorial 
display screens arranged in an ordered array, 

providing said display screens with 
electrical signals pictorially representing a selected 
limited number of said sequence of said labels, and 

changing the displayed labels. 



37. The composing method of claim 36 further 

10 comprising the step of 

receiving electrical signals repre- 
senting an image to be displayed, and 

repeatedly displaying said received 
image on a pictorial display screen associated with a 
15 display processor. 



33. The composing method of claim 36 further 

comprising the step of 

selectively sequencing said labels on 

plural display screens according to said label sequence 
for searching for a labeled segment of said image 



source. 



39. The composing method of claim 34 further 

comprising the step of 

labeling each segment by two pictorial 

25 images, a first label image corresponding to a 

beginning frame of said segment and a second label 
image corresponding to an ending frame of said segment. 



40. The composing method of claim 34 

comprising the steps of /^I^Al; 

pM?L 
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storing a representation of said segment 
to be displayed "in at least a first and a second serial 
storage medium/ 

selectively controlling image infor- 
5 mation retrieval from said first and second storage 



41. The composing method of claim 40 further- 
comprising the step of 

inserting an interruption display image 

15 between repetitions of said repeating segment. 



42. The composing method of claim 34 further 

comprising the steps of 

storing a representation of a first 

segment .to be displayed in a first serial storage 
20 memory, 

storing a representation of a second 
segment to be displayed in a second serial storage 
memory/ 

selectively controlling image infor- 
25 mation retrieval from said first and second serial 
memories / and 

repetitively and alternately displaying 
said first and second segments in a continuous loop 
alternating presentation. 



30 



repetitively cycling said first and 
second storage media for alternate image information 

retrieval/ and 
10 thereby displaying a continuous loop 

* 

presentation of said segment. , ^ 



-: ■ < 



43. The composing method of claim 42 further 
comprising the step of .^f&EATr 
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varying a transition between said first 
and Second segments. 



44. The composing method of claim 43 further 

comprising the steps of 
5 generating a transition display between 

'* said first and second segments, and 

inserting said transition into the 
serially connected image sequence between said first 
and second segments . 



10 45. The composing method of claim 40 further: 

comprising the step of 

dynamically changing the start and end 

of said segments. 



46. The composing method of claim 45 further 

15 comprising the steps of 

switchably connecting video outputs of 

selected ones of a plurality of video tape recorders to 
selected ones of a plurality of display screens, 

digitizing a switched recorder video 

20 output, 

directing *said digitized video output to 

a display processor, and 

displaying said received digitized video 

image on a said pictorial display screen associated 
25 therewith. 



■ 

47. The composing method of claim 46 further 

comprising the steps of 

connecting selected ones of a plurality 
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of video input lines to selected ones of said video 
tape*, recorders , 

generating clock signals including field 

address signals, and 
5 selectively adding said address signals 

to video image data generated within said apparatus. 



48. The composing method of claim 45 further 

comprising the steps of 

generating clock signals including field 

10 address signals/ 

selectively adding said address signals 

to video image data generated within said apparatus, 
and 

connecting said clock signals to each of 
15 a plurality of said recorder interfaces. 



49. A method for composing image source 
material stored on at least one image storage medium, 
said source material being composed of a sequence of 
serially stored fields representing a time sequential 
20 visual image, sequences of said fields being associated 
to form visual segments, said method comprising the 
steps of 

providing a pictorial representation of 

a selected current segment of interest, 
25 providing an operator control means, 

repetitively selecting successive 

current segments, 

repetitively making available for 

display electrical signals pictorially representing a 
30 then selected current segment, 

selecting from the then current segment 
at least one labeling field for identifying said 
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segment, 

delimiting said current segment to form 
a current defined segment by denoting the beginning and 

ending of said segment, 

maintaining a record of said sequences 

of defined segments in accordance with the label 
selecting and delimiting steps, and 

selectively providing electrical signals 

for pictorially representing and displaying at least a 
labeling field. 



50. A method for composing image source 
material stored on at least one image storage medium, 
said source material being composed of a sequence of 
serially stored fields representing a time sequential 
15 visual image, sequences of said fields being associated- 
to form a visual segment, said method comprising the 
steps of 

providing a temporal pictorial presen- 
tation of a selected segment,, designated the current 
20 segment, on an active pictorial display, 

providing on each of a plurality of 
passive pictorial displays a visual presentation of a 
selected field of a sequence of fields forming a said 
visual segment, each said selected field thereby 
25 labeling one said visual segment, 

repeatedly selecting among said 
sequences of selected label fields for composing said 
segment sequences, a segment associated with a last 
selected label field being the segment designated the 

3 0 current segment, 

repetitively providing said active 

display with electrical signals from memories for pic- 
torially representing said current segment in a 
repeating display, 
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selectively supplying each said passive 
display with electrical data signals representing a 
selected one of a sequence of said labeling fields, 

associating with each current segment at * 

5 least one current label field, and s 

maintaining a record of the sequence of 

current segments. s 



51. The composing method according to claim 

50 further comprising the step of 
10 manipulating said label fields repre- 

senting said segments for forming a composed medium 
representation. 



5 2. The composing method according to claim 

50 further comprising the step of 
15 selectively and repetitively switching 

between said video output of at least two recording 
means for repetitively providing said current segment 
in a continuous loop format to said active display 

means • 



20 53. The composing method of claim 52 further 

comprising the steps of 

varying the segment playback rate of the 

current segment being displayed by said active pic- 
torial display, and 
25 designating for a current segment a 

beginning field label and an ending field label. 



54. The composing method of claim 50 further 
comprising the steps of 
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ordering in a regular spatial array a 
plurality of pictorial display pairs, each pair having 
a first display screen for providing a visual presen- 
tation of a beginning label and a second display screen 
5 for providing a visual presentation of an ending label, 
each said pair of beginning and ending labels being 
associated with a segment of the sequence of current 
segments, and 

selecting a segment corresponding to a 
10 selected label for display by said active display. 



55. The composing method of claim 50 further 

comprising the step of 

receiving instructions and video data 

representing pictorial labels on a display interface 
15 for effecting an ordered pictorial presentation of said 
labels on display screens, . 

whereby the spatial display on said 
screens provides in effect a temporal snapshot repre- 
sentation of a sequence of • said segments. 



20 



56. The composing method of claim 55 further 

comprising the steps of 

mounting said display screens in a two 

row ordered array on a console, each column of screens 
being adapted to display a label pair associated with a 

25 visual segment, and 

dynamically searching through said 

labels by shifting said labels in the direction of an 
array row, 

whereby a search through said sequence 
3 0 of segments can be effected. 
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57. The composing method of claim SO further 

comprising the steps of 

writing a clocked identification tag to 

be associated with each said field, each identification 
5 tag for a field associated with one storage medium 

being uniquely identifiable from the identification tag 
associated with any other field -associated with said 

one storage medium , 

receiving instructions including at 

10 least a playback start time relative to a system clock, 
a starting field identification, and an ending field 

identification, and 

retrieving data from said storage medium 

in accordance with said instructions. 



15 ss. The composing method of claim 57 wherein- 

each said storage medium is a video tape recorder, and 

comprising the steps of 

recording on said recorder a video 

input signal, and 
2Q recording with said video signal 

said clocked identification tags. 



59. The composing method of claim 50 further 

comprising the steps of » 

storing a digital representation of a 

25 label to be displayed, 

communicating said digital represen- 
tation along a digital bus, and 

providing said digital representation 

from said bus to a display screen for providing a 
30 visual presentation; 
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60. The composing method of claim 59 further 

comprising the steps of 

controlling the data retrieving playback 

operation of a plurality of playback devices, 

selectively switching between playback 

device video output lines for connecting a selected one 

video output line as a switch means output line, and 

providing a digital output video signal 

for said selected video output. 



61. The composing method of claim 50 further 

comprising the steps of 

automatically dividing said source 

material into segments according to a predetermined 

selection method and 

changing said beginning and ending 
fields of said segments whereby the segment presen- 
tation displayed by said active display is dynamically 
updated to visually represent said new beginning and 
ending fields. 



62. The composing method of claim 50 further 

comprising the steps of 

inputting textual material associated 

with a labeled scene, 

printing a storyboard, said storyboard 

25 representing thereon a series of scenes, each repre- 
sented by at least one pictorial label and the pre- 
viously input textual material associated therewith. 



63. The composing method of claim 50 further 

comprising the step of 

simultaneously controlling the playback 
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operation of a plurality of video tape recorders for 
selectively providing the video signal data to the 
passive and active displays in response to instructions 
from an operator control panel. 



64. The composing method of claim 50 further 

comprising the step of 

shifting, in time, an audio signal inde- 
pendently of a video signal for synchronizing said 
audio and video signals. 



10 



65. The composing method of claim 50 further? 

comprising the step of 

selectively switching said passive pic- 
torial display for presenting text material for display 
with said visual presentation by shifting the pictorial 
display in a vertical direction. 



15 66. The composing apparatus of claim 20 

further comprising 

means for supplying a video independent 

audio signal, and 

means for synchronizing said audio 

20 signal with a current video segment, said synchronizing 
means comprising 

means for time shifting said audio 

signal relative to said video segment, and 

means for varying the rate of said 

25 time shifting. 



67. The composing apparatus of claim 25 
further wherein 
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said composing control means comprises 
mearis for adding text material to said pictorial label 
representing electrical signals, and 

switch means for selectively displaying 
said text material on said passive display screens. _ 



68. Apparatus for composing image source 
material stored on at least one image storage medium, 
said source material being composed of a sequence of 
stored frames representing a time sequential visual 
image, sequences of said frames being associated to 
form a video segment, said composing, apparatus 
comprising 

a plurality of pictorial display means 
arranged in an ordered array, each display means pro- 
viding a visual presentation of a video label selected ■ 
from a sequence of labels, said label sequence repre- 
senting a sequence of said video segments, each said 
selected label identifying one said video segment, 

an operator control means, and 
a composing control means operative with 
said medium and said operator control means, said com- 
posing control means comprising 

means for selectively supplying each 
said pictorial display means with electrical data 
signals representing a selected one of said sequence of 
labels, 

means responsive to said operator 

control means for changing the labels displayed by said 

plural pictorial display means, and 

said supplying means further having 

means responsive to said changing means for smoothly 
scrolling said labels across said ordered array of 
display means. 
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69. The composing apparatus of claim 68 
wherein said changing means comprises 

means for changing the displayed labels 

in a serial fashion, and 

said smoothly scrolling means comprises 
a display processing control element, 

and 

a display processing unit, 

said unit having at least one row 

10 processor, each row processor comprising 

a plurality of digitized picture 

generators, each generator receiving digitized picture 
data representing labels to be displayed, and 
generating an analog picture output representing said =• 

15 digitized picture data, and 

a plurality of analog routing 

elements, each element having as its inputs, at least a 
plurality of said picture generator analog outputs, 
each routing element being adapted to select as its 
20 output, in response to a controlling input signal, one 
of said picture generator output signals, - 

each routing element being con- 
nected to a said pictorial display means. 



25 



30 



70. The composing apparatus of claim 69 
wherein each said digitized picture generator comprises 

a picture memory for storing digitized 
picture data in an ordered picture array, 

a memory address counter for outputting a 
sequence of digital addresses, said addresses 
corresponding to picture elements of a digitized pic- 

ture , 

an offset register for providing an off- 
set counter representing a spatal offset for said pic- 
ture , and 
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an adder for adding the output of the 
offset register 'to at least a portion of the address 
output of the address counter, 

said adder output in combination with a 
second portion of address counter output being the 
memory address applied to. said picture memory. 



71. The composing apparatus of claim 70 
wherein said display processing control further compri 



ses 



means for periodically varying the value 

of said offset register, and 

means for varying the selected output of 

the routing elements for selectively changing the out- 
put signal thereof, 

said selected change occurring at a wrap' 

around position -corresponding to the value in said off 
set register. 



72. The composing apparatus of claim 68 

wherein said changing means comprises 

means for changing the displayed labels 

in a serial fashion, and 

said smoothly scrolling means comprises 
means responsive to said operator 
control means for continuously scrolling said labels 
25. across said ordered array of display means, and 

means responsive to said operator 
control means for terminating said smoothly scrolling 
display. 



30 wherein 



73. The composing apparatus of claim 72 
said operator control means comprises a rota- 
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tion means for controlling said smooth scrolling by 
sai*. composing control means, and 

said composing control means, when said 
rotating means rotates in a direction opposite to said 
smooth scrolling, having means for terminating said 
smooth scrolling of said labels across said ordered 



array 



10 



15 



20 



74. A method for reviewing image source 
material stored on at least one storage medium, the 
source material being composed of a sequence of stored 
frames representing a time sequential visual image, 
sequences of the frames being associated to form a 
video segment, the composing method comprising the 
steps of 

selectively supplying to each of a plura- 
lity of pictorial display screens electrical data 

. . _ _ co ia r Hve one of a sequence of 
signals representing a selective Ulie WJ - ^ 

labels, and 

changing the labels displayed by the pic- 
torial display screens, by smoothly scrolling the 
labels across the display screens in an ordered 
fashion. 



75. The method of claim 74 wherein 

said changing step comprises the step of 
25 changing the displayed labels in a serial fashion, and 

said smoothly scrolling step comprises 
the step of sequentially stepping said labels across 
said screens. 



76. The method of claim 74 further comprising 
30 the step of 
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terminating said smoothly scrolling of 
id labels in response to an actuation at an operator 
control means* 



t 



77. In a composing apparatus for selecting 
segments from image source material stored in at least 
one storage medium and for denoting serially connected 
sequences of said segments, said composing apparatus 
comprising 

an operator input means, 
10 a pictorial display means, and 

a composing control means responsive to 
said operator input means for controlling said storage , 
media and said pictorial display means, 

said operator input means comprising an 
15 operator controlled, manually operable, control panel _ 
having 

a first rotary control wheel, 
a second rotary control wheel, 
a plurality of switch elements adja- 

20 cent said first control wheel, 

a second plurality of switch elements 

adjacent said second control wheel, 

said first plurality of elements and said 
first control wheel having a first spatial con- 
25 figuration for providing tactile stimulation feedback 
to an operator of the apparatus regarding switch ele- 
ment location, and 

said second plurality of elements and 

>- said second control wheel having a second spatial con- 

30 figuration for providing tactile stimulation feedback 
? to said apparatus operator regarding switch element 

location, 

whereby said operator can visually con- 
centrate on said display means while operating said 
35 input means with minimal visual feedback- .^fREXt? 

OMPI 



<W 



BNSOOCID: <WO. 



B402606A1_I_> 



WO84/02606 



PCT/US83/01955 



-13 Q- 



78. The composing apparatus of claim 77 
wherein each said control panel control wheel has 
thirty detent positions for each 360- rotation of the 
wheel. 



5 79. The composing apparatus of claim 77 

wherein each spatial configuration of elements compri- 
ses 

a first plurality of switch elements 
arranged in a spaced apart linear array juxtaposed to 

10 said first wheel, 

a second plurality of switch elements 

arranged in a second spaced apart linear array jux- 
taposed to said first linear array along a side thereof 
spaced away from said first control wheel, 
15 . the switch elements at each end of said - 

first linear array and second linear arrays defining 
respectively an upper and a lower tactile feedback 
region, and 

a plurality of switch elements at the 
interior of said first linear array defining respec- 
tively an upper and a lower interior tactile stimula- 
tion region. 



20 



25 



30 



80. The composing apparatus of claim 79 
wherein each of said switch elements comprises 

a depress ible key switch element, 
each switch element having a finger con- 
tacting cap portion, the spatial extent of said cap 
portions of said first linear array, in a direction 
transverse to the orientation of said first linear 
array, and at a side closest to said control wheel 

being variable, 

whereby said interior tactile stimulation 
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regions can be created and further whereby upper and 
lower tactile stimulation regions can be created at the 
ends of said linear arrays. 



81. The composing apparatus of claim 80 
5 further wherein said control panel has 

a plurality of levers symmetrically 

spaced around each control wheel, and 

means for mounting said levers in a posi- 
tion opposed to and spaced apart from, said respective 
10 control wheels. 



8 2. In a composing apparatus for selecting 
video segments from image source material stored in at 
least one storage medium, and for denoting serially 
connected sequences of said segments, a composing 

15 method comprising the steps of 

arranging a manually operated control 

panel to provide tactile stimulation feedback to the 
operator of the composing apparatus, and 

enabling said operator to visually con- 
20 centrate on a pictorial display while operating said 
control panel with minimum visual feedback from manual 
elements thereof. 



83. Apparatus for composing image source 
material stored on at least one image storage medium, 
25 said source material being composed of a sequence of 
stored frames representing a time sequential visual 
image, sequences of said frames being associated to 
form a video segment, said apparatus comprising 

an active pictorial display means for 
30 providing a temporal pictorial presentation of a 
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selected segment , 

a plurality of passive pictorial display 

means, each passive display means for providing a 
visual presentation of a selected label frame from a 
sequence of frames forming a video' segment, each said 
selected frame thereby labeling one said video segment, 

a plurality of cursor indicating ele- 
ments, each element being associated with a said 

passive display means, 

an operator control means, and 

a composing control means operative 

with said operator control means, said composing 

control means comprising 

means responsive to said operator, 

15 control means for selecting among said label frames 
displayed on said passive display means for enabling 

editing of said source material, 

said selecting means comprising 

cursor control means for selecting from among said 
indicating elements, each said selected indicating ele- 
ment designating a corresponding passive display means. 



20 



84. The composing apparatus of claim 83 

further comprising 

means for mounting said passive displays 

25 in a first and a second linear array, said arrays being 

juxtaposed to one another, 

means for mounting each said cursor indi- 
cating element in a location spatially near to said 
associated passive display, and 

each indicating element comprising an 
illumination device for indicating the state of the. 
element. 



30 
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85. The composing apparatus of claim 84 
further comprising a manually operable lever control 
means for controlling, by the position of the lever, 
selection and illumination of at least one cursor indi 
5 eating element. 



86. The composing apparatus of claim 83 
wherein said plural passive display means includes 

means for mounting said display means in 
an upper and a lower horizontal linear array, 
1Q and further comprising 

means for mounting a said cursor 
indicating element above each upper and below each 
lower display means for indicating to the operator the 
labels which have been selected. 



15 



20 



25 



87. A composing method for editing segments 
from image source material stored in at least one 
storage medium and for denoting serially connected 
sequences of said segments, said method comprising the 

steps of: 

selectively displaying segments of said 
image source material on a pictorial display means, 

identifying each said segment by a pic- 
torial image segment label, 

assembling at least a plurality of said 
labels for said segments into a label sequence, and 

operating upon a sequentially related 
plurality of said labels for said segments as a single 
label, said single label identifying a plurality of 
said segments. 



30 



88. The composing method of claim 87 wherein 
said operating step comprises the step of 



OM7I 



QMcsnnrin- <wn 8402606A1_L> 



, - * ■ PCT/US83/01955 
WO84/02606 



-134- 

combining a sequentially related plura- 
lity, of said labels for said segments into said single 
label, and 

said method further comprising the steps 

5 of 

identifying each segment by a pictorial 

image segment label pair, and 

said single label is a pictorial image 
segment label pair selected from the label frames iden- 
10 tifying said segments. 



89. The composing method of claim 88 further 

comprising the steps of 

providing a plurality of pictorial 
display screens arranged in a first and a second spaced 

15 apart linear array, 

providing juxtaposed to each said display 

screen a cursor position indicating element, 

providing said display screens with 
electrical signals pictorially representing a selected 
20 sequence of label pairs, each label pair representing a 
segment, 

displaying on each spatially related pair 
of said display screens a said label pair, a screen of 
said first array displaying a beginning label and a 
25 spatially related screen of said second array 
displaying an ending label of said pair, and 

said combining step comprising the steps 

identifying, using said cursor indicating 
30 elements, a beginning label of said single label, 

identifying, using said cursor iden- 
tifying elements, a later occurring, ending label of 

said single label, and 

collapsing said beginning label, said 
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ending label, and all labels therebetween into said 
single label. 



90. The composing method of claim 89 wherein 
said first and second label identifying steps comprise 
the steps of 

fixing the cursor in position at an indi- 
cating element associated with the beginning label of a 

first segment label pair, 

moving the cursor associated with the 
ending label of the first segment from a position jux- 
taposed to said ending label of said first segment to a 
position indicating element juxtaposed to the ending 
label of a later occuring second segment label pair, 
and 

15 fixing the cursor in position at an indi- 

cating element associated with .said ending label of 
said second segment label pair. 



91. The composing method of claim 89 further 

comprising the step of 
20 mounting said first and second spaced 

apart linear arrays of display screens in a horizontal 
direction, 

whereby said related display screens form 
a vertically related pair of display screens. 



25 92.. The composing method of claim 87 wherein 

said operating step comprises the steps of 

identifying said plurality of labels 

using a cursor indicating, array/ 

pulling said plurality of segments 
30 denoted by said plurality of labels in a single pull 
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operation, and 

inserting said plurality of pulled 
segments into an assembly of segments at a selected 
position and in a single insert operation. 



10 



93. In a composing apparatus for selecting g 
segments from image source material stored in at least 
one storage medium and for denoting serially connected 
sequences of said segments, said apparatus comprising 

a pictorial display means, 
an operator control means, and 
a composing control means responsive to 
said operator control means for controlling said 
storage medium and said pictorial display means, 

an action scrolling apparatus comprising 
15 means responsive to said operator control- 

means for selectively displaying segment frames on said 

pictorial display means, 

said operator control means having an 

operator controlled, manual rotation means for varying 
20 the segment frame displayed on said display means, 

said rotation means having a plurality of 
operating positions, said displaying means being 
responsive to each successive position of said rotation 
means for displaying a next successive frame, the 
25 direction of said next frame with respect to the pre- 
sent displayed frame corresponding to the direction of 
rotation of said rotation means, 

whereby, through back and forth rotation ? 

of said rotation means, action scrolling of said 
30 segment frames can be achieved. 



94. The action scrolling apparatus of claim 
93 further wherein said rotation means comprises 
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a detent mechanism having detent posi- 
tionp spaced each twelve degrees of rotational move- 
ment , and 

said control, responsive means has means 
responsive to each next detent of movement of said 
rotation means for varying the frame displayed on said 
display means by one video frame. 



95. A composing method for providing action 
scrolling in an apparatus for selecting segments from 
image source material stored in at least one storage 
medium and for denoting serially connected sequences of 
said segments, said method comprising the steps of 

displayed segment frames on a pictorial 

display screen, 
15 varying the segment frame displayed on 

said display screen by* using an operator controlled 

manual rotation element/ and 

rotating said element back and forth for 
providing an action scrolling of the segment frames on 
20 the display screen* 



96. In a composing apparatus for selecting 
segments from image source material stored in at least 
one storage medium an<3 for denoting serially connected 
sequences of said segments, said apparatus comprising 
25 a pictorial display means, 

an operator control means, and 
a composing control means responsive to 
said operator control . means for controlling said 
storage medium and said pictorial display means, said 
30 composing control means having means for temporally 

trimming said segments, 

the trimming- means comprising 
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means for selectively displaying a 
segment to be trimmed on said pictorial display means, 

means for displaying a start and an end 
frame of said displayed segment to be trimmed, 

operator responsive means for changing at 
least one of beginning and end of said displayed 
segment in response to said operator control means, and 

said operator control means comprising 

a beginning frame and an ending frame 
control element for changing in combination with said 
operator responsive means, the beginning and end 
respectively of said displayed segment. 

97. The trimming apparatus of claim 96 
further wherein said operator control means comprises 

a first and second accept key, for indi- 
cating, when simultaneously activated, that a changed 
displayed segment shall replace the originally 
displayed segment. 



20 



98. The trimming means of claim 96 further 
wherein each said control wheel comprises 

a detent mechanism having a plurality of 
detent positions through which the control wheel 
passes, said composing control means being responsive 
to each detent position for trimming the segment being 
displayed by one frame. 



25 



99. The trimming means of claim 96 further 
comprising 

means for displaying, during trimming, 
the changed beginning and ending frames of the segment 
being trimmed. 
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100. The trimming means of claim 96 wherein 
saioS. selective displaying means comprises 

means for storing said displayed segment 

on a video tape recorder, 

means for controlling said recorder for 
repeatedly playing back and rewinding said segment, and 
means for controlling said display for providing a pre- 
determined image display when said tape recorder is 
rewinding to the beginning of said displayed segment. 



10 101. The trimming means of claim 96 further 

comprising 

means for selectively displaying in one 
of a film-style and a video-style presentation said 
beginning and ending frames of the segment being 
15 trimmed. 



102. The trimming means for claim 101 further 
comprising 

highlighting, during the film-style presentation, the 
display of frames forming a part of the trimmed 
20 segment. 



103. A trimming method for use in a composing 
apparatus for selecting segments from image source 
materials stored in at least one storage medium and for 
denoting serially connected sequences of said segments, 

2 5 said method comprising the steps of 

selectively displaying a segment to be 

trimmed on a pictorial display screen, 

displaying a beginning and an ending 

frame of the segment to be trimmed, 

changing at least one of the beginning 
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and ending of the displayed segment in response to 
operator controls. 



104. The trimming method of claim 103 further 

comprising the step of 

providing a fail-safe system for 

requiring simultaneous actuation of at least two 

control elements for accepting a new, temporally 

changed, displayed segment. 



105. The trimming method of claim 103 further 

10 comprising the step of 

displaying in freeze frame appearance the 

changed beginning and ending frames of the segment 
being trimmed during the changing step. 



106. The trimming method of claim 103 further 

15 comprising the step of 

selectively displaying in one of a film- 
style presentation and a video-style presentation said 
beginning and ending frames of the segment being 
trimmed. 



20 



107. The trimming method of claim 106 further 

comprising the step of 

highlighting, during the film-style pre- 
sentation, the display of frames forming a part of the 
trimmed segment. 



25 108. Apparatus for composing image source 

material stored on at least one image storage medium, 
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said source material being composed of a sequence of 
stored frames representing a time sequential visual 
image, sequences of said frames being associated to 
form a video segment/ said composing apparatus 
5 comprising 

means for inputting said source material 
and for recording said source material in said storage 
medium, 

means for segmenting said source material 

10 as it is being input/ 

means for digitizing frames of said 
source material/ as said source material is being 
input, each segment having associated therewith at 
least one digitized frame, 
15 a plurality of pictorial display means 

arranged in an ordered array, each display means pro- 
viding a visual presentation of a video label selected • 
from a sequence of said digitized frames, said video 
labels, in sequence, representing a sequence of said 

20 video segments, 

means for storing said digitized frames, 

an operator control means, and 
a composing control means operative with 
said frame storage medium and said operator control 
25 means, said comppsing control means comprising 

means for selectively supplying each 
said pictorial display means, while said source 
material is being input, with electrical data signals 
representing a selected one of said sequence of labels, 
30 and 

means responsive to said operator 
control means for sorting the label sequence displayed 
by said plural pictorial display means* 



109. The composing apparatus 
35 wherein said sorting means comprises 



of claim 108 
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means for changing the order of the 

displayed label sequence, and 

said inputting means comprises 

means for automatically forming video 

segments from said source material, each formed segment 

having a predetermined time duration. 



10 



110. The composing apparatus of claim 108 
wherein said storage medium comprises a plurality of 

video tape recorders, and 

said inputting and recording means 

records said source material on all of the tape recor- 
ders. 



15 



20 



111. A method for composing image source 
material stored on at least one storage medium, the 
source material being composed of a sequence of stored 
frames representing a time sequential visual image, 
sequences of the frames being associated to form a 
video segment, the composing method comprising the 
steps of 

inputting and recording said source 

material on said storage medium, 

segmenting said source material as it is 

* 

being input, 

digitizing frames of said source material 
25 as it is being input, each segment having associated 
therewith at least one digitized frame, 

storing said digitized frames, 
selectively supplying to each of a plura- 
lity of pictorial display screens, while said source 
material is being input, electrical data signals repre- 
senting a selective one of a sequence of said digitized 
frames, said sequence representing a sequence of said 
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video segments, and 

sorting the frame sequence displayed by 

the pictorial display screens. 



112. The composing method of claim 111 wherein 
5 said sorting step comprises the step of changing the 
order of displayed frame sequence, and 

automatically forming said video segments 
from said source material, each formed segment having a 
predetermined time duration. 



10 



113* The composing method of claim 111 further 

comprising the step of 

recording said source material on all of - 

a plurality of video tape recorders. 



114. Apparatus for composing image source 
15 material stored on a plurality of video tape recorders, 
said source material being composed of a sequence of 
stored frames representing a time sequential visual 
image , sequences of said frames being associated to 
form a video segment, said composing apparatus 
20 comprising 

means for directing said source material 
to each of a plurality of video recorders, 
a plurality of video recorder interface circuitries, 
each of said plurality of recorders connected to a said 

25 interface circuitry, 

a system clock generator connected to 

each interface circuitry, and 

each interface circuitry further having 
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means for writing an internal time 
codeuassociated with each frame being recorded on its 

connected video recorder , and 

said interface circuitries and said 

5 system clock generator being connected so that the same 
video source frame, when written on different video 
recorders carries with it the same internal time code 
identification. 

115. The composing apparatus of claim 114 
io further wherein said writing means comprises 

means for writing a frame sequential time 
code wherein the time between two frames written on a : 
video tape recorder is equal to the difference in 
internal time codes associated with said respective 

15 frames. 



20 
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116. A method for composing image source 
material stored on a plurality of video tape recorders, 
said source material being composed of a sequence of 
stored frames representing a time sequential visual 
image, sequences of said frames being associated to 
form a video segment, said composing method comprising 

the steps of 

directing the source material to each or 

a plurality of video tape recorders, 

connecting each of a plurality of video 
recorder interface circuitries to a said video recorder 
respectively r 

providing a common system clock to eaph 

interface circuitry, 

writing an internal time code associated 

with each said frame and recording said time code along 
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with the frame on the video recorder, and 

synchronizing said interface circuitries 
and said system clock so that the same video source 
frame, when written on different video recorders, 
carries with it the same internal time code iden- 
tification. 



117. The composing method of claim 116 further 

comprising the step of 

determining the time between two frames 
10 on a video tape recorder by differencing the internal 
time codes associated with each said frame. 



118. Apparatus for composing image source 
material stored on a plurality of storage media, said 
source material being composed of a sequence of stored 
15 frames representing a time sequential visual image, a 
sequence of said frames being associated to form a 
video segment, said composing apparatus comprising 

a plurality of sources of video data, 
a plurality of elements for receiving 

20 video data, 

a plurality of routing circuits, 
a video bus, said bus having a separate 
transmission path for each said video source, 

means for connecting each video source to 

25 a different transmission path, 

means for connecting a routing circuit 
between said bus and each video receiving element, and 

means for controlling each said routing 
circuit for providing a selected video data signal to 
30 its connected receiving element. 
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119. The composing apparatus of claim 118 

further comprising 

a plurality of interface circuits, each 

circuit connected between a said storage medium and an 

associated routing circuit, < 

each said interface circuit having cir- ^ 

cuit means for controlling said connected routing cir- , 
cuit. 



120. The composing apparatus of claim 118 

10 further wherein 

said bus further comprises a plurality of 

audio transmission paths, one path being available for f 

each audio signal source of said apparatus. 



20 



121. A method for composing image source 
15 material stored on a plurality of storage media, the 
source material being composed of a sequence of stored 
frames representing a time sequential visual image, a 
sequence of the frames being associated to form a ndao 
segment, the composing method comprising the steps of 

connecting each source of video data to a 
transmission path of a video bus,, connecting each 
transmission path to a plurality of routing circuits, 

and _ 

controlling each said routing circuit for 

25 providing a selected video data signal from a selected 
transmission path to at least one video receiving cir- 
cuit connected to said routing circuit, whereby each 
said video receiving circuit can receive any of the 
video signals along said transmission paths. 



30 
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122. The composing method of claim 121 further 
comprising the steps of 
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connecting between a storage medium and 
an associated routing circuit an interface circuit, 
addressing said routing circuit by said interface cir 
cuit for controlling the connection between the asso- 
ciated storage medium and the transmission paths, and 

connecting each storage medium to a 
transmission path for supplying data thereto. 



123. The composing method of claim 121 farther 

comprising the steps of 
10 providing a plurality of audio 

transmission paths , and 

making one path available for each of a 

plurality of audio signal sources. 



15 124. A composing method for editing segments 

from image source material stored in at least two 
storage media and for denoting serially connected 
sequences of said segments, said method comprising the 

steps of 

20 identifying each said segment by a pic- 

torial image segment label , 

displaying a transition from one segment 

to a next segment in a continuing loop display on a 

^ display screen, 

25 displaying the end frame of said one 

A. segment and the beginning frame of the next segment on 

* respective display screens, 

providing a selected one of a film-style 

presentation and a video-style presentation of said end 
30 frame and said beginning frame, and 

selectively switching under an operator 
control between said film-style and video-style presen- 
tations. 



BNSOOCID: <WO 8402606A1_1_> 



PCT/US83/01955 

WO84/02606 



-148- 



10 



125. The composing method of claim 124 further 

comprising the step of 

highlighting the frames of said segments 

in said film-style presentation for displaying said 
5 transition between segments. 

126. A composing apparatus for editing 
segments from image source material stored in at least 
two storage media and for denoting serially connected 
sequences of said segments, the apparatus comprising 

means for identifying each said segment 

by a pictorial image segment label, 

means for displaying a transition from 
one segment to a next segment in a continuing loop 

display on a display screen, 

means for further displaying the end 
frame of said one segment and the beginning frame of 
the next segment on respective display screens, 

means for providing a selected one of a 
film-style presentation and a video-style presentation 
20 of the end frame and the beginning frame, and 

means for selectively switching under an 
operator control between said film-style and video- 
style presentations. 



127. The composing apparatus of claim 126 

25 further comprising 

means for highlighting the frames of the 

t-h*» film-stvle presentation for 
segments presented m the rum f 

displaying the transition between segments. 



15 



128 In a composing method for editing 
30 segments from image source material stored in at least 
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one storage medium and for denoting serially connected 
sequences of the segments, the segments each being 
identified by a pictorial image segment label, said 
labels being assembled into a label sequence, the 
display review method comprising the steps of 

identifying a label group of said label 
sequence, said group being associated with a plurality 
of segments recorded on each, of a plurality of storage 
media, and 

displaying said sequence of segments in a 
continuously repeating loop. 



e- 



129. The method of claim 128 further 

comprising the steps of 

determining a sequence in which said 

15 plurality of storage media shall operate to display 
said identified segments, and 

determining a time, a location, and a 
duration of play for each of said storage media for 
displaying said continuous loop of said grouped 

20 segments. 



130. The apparatus of claim 1 further comprising 
means for storing said label sequence as 
a sequence of image pairs, each image pair for a label 
comprising a designation of the memory location of a 
25 next previous image pair, a designation of the memory 

location of a next succeeding image pair, a designation 
of the memory location of the label, and a designation 
of the memory location of the associated segment. 

* 



131. The apparatus of claim 130 further 
30 wherein said label comprises 
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a first frame and a second frame of said 
associated segment. 



132. The method of claim 50 further comprising 

the steps of 

5 storing said label sequence as a sequence 

of image pairs, each image pair for a label comprising 
a designation of the memory location of a next previous 
image pair, a designation of the memory location of a 
next succeeding image pair, a designation of the memory 

10 location of the label, and a designation of the loca- 
tion of the associated segment. 

133. The method of claim 132 further 

comprising the step of 

providing a first frame and a second 

frame of a segment for pictorially labeling said 
15 segment. 
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